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FOREWORD 


This  report  is  a  compilation  of  sixteen  (16)  papers  covering  various 
topics  in  the  general  area  of  operational  training  researcj^5^<l)}ie^e  papers 
conaial  uf  ygllialim  and  aMmmaPs*y9  89ntaWa«ap^»wigJby  individuals  from 
12  different  organizations  which  include  both  U.  S.  Navy  and  civilian  contract 
agencies.  These  presentations  were  delivered  at  a  training  research  con¬ 
ference  during  the  period  31  October  and  1  November  196^  The  training 
research  conference  was  jointly  sponsored  by  the  Offieeof  Naval  Research, 
Bureau  of  Naval  Personnel  a,nd  the  Naval  Training  Device  Center  and  was 
hosted  by  Human  Sciences  Research,  Inc.,  located  in  McLean,  Virginia. 

training  research  conference  provided  an  opportunity  for  in¬ 
terested  Navy -experienced  research  personnel  to  describe  their  past  and 
current  research  projects  and  to  participate  in  discussion  relevant  to  the 
conference  objectives.  The  primary  objective  of  the  conference  was  to 
obtain  current  research  status  information  which  would  serve  as  initial  in¬ 
puts  towards  the  construction  of  a  Navy-wide  coordinated  Operational 
Training  Research  and  Development  Program. 

T 

This  report  includes  copies  of  the  formal  presentations  given  at  the 
conference  but  not  discussion  and  summary  remarks.  These  informal  comments 
are  stored  on  tape  and  are  being  extracted  for  use  as  inputs  to  the  next  training 
research  conference  planned  to  be  held  at  Princeton  University  sometime 
between  mid-January  and  mid-Februaiiy,  1964. 


The  16  papers  given  at  the  trailing  research  conference  are  grouped 
into  five  sections  in  this  report.  The  basis  for  grouping  is  both  one  of  con¬ 
venience  and  because  the  organization  does  reflect  fairly  common  topics  or 
subject  matter  areas. 
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Section  A  consists  of  4  papers  dealing  specifically  with  topics  directly 
relevant  to  the  initial  steps  taken  in  the  construction  and  implementation  of 
a  Navy-wide  Operational  Training  Research  and  Development  Program.  The 
first  is  by  Dr.  Glenn  Bryan  of  the  Training  Research  Branch  of  ONR  and 
covers  the  background  actions  and  decisions  which  led  to  the  formulation 
of  an  outline  plan  for  an  operational  training  R/D  program.  It  also  briefly 
describes  the  sequential  tasks  contained  in  the  skeleton  plan.  Dr.  John  A. 
Whittenburg,  of  Human  Sciences  Research,  Inc.  describes  the  approach  and 
initial  results  of  the  first  task  specified  in  the  plan,  the  development  of  be¬ 
havioral  specifications  for  key  personnel  and  subteams  in  AAW.  Then,  Dr. 
Edward  Weiss  of  the  Matrix  Corporation,  discusses  the  current  progress 
and  approach  being  taken  in  the  conduct  of  the  second  task  specified  in  the 
plan,  a  study  of  procedures  and  research  planning  for  AAW  training  programs. 
The  section  is  concluded  by  Mr.  John  Nagay  of  the  Office  of  Naval  Research. 
He  presents  some  of  the  major  requirements  and  functions  to  be  accomplished 
in  attaining  an  effective  coordinated  Navy-wide  operational  trsdning  R/D 
program. 

Section  B  consists  of  five  papers.  These  describe  relevant  p.  .st, 
current,  and  planned  research  programs  of  the  Office  of  Naval  Research, 
the  Naval  Training  Device  Center,  ana  me  tsureau  oi  xiiaval  Fexouuuol. 

The  ONR  program  is  described  by  Dr.  Bryan.  Dr.  James  Regan  of  the 
Naval  Training  Device  Center  identifies  projects  in  the  NTDC  program 
which  relate,  in  varying  degrees,  to  the  general  area  of  operational  training. 
Mr.  Sid  Friedman  of  the  Bureau  of  Naval  Personnel  briefly  indicates  the 
many  and  diversified  research  projects  of  the  Bureau  of  Naval  Personnel 
which  are  relevant  to  the  plan.  Dr.  Earl  Jones  of  the  Personnel  Training 
Research  Laboratory  discusses  past  and  current  research  tasks  conducted 
by  the  laboratory  and  emphasizes  many  of  the  problems  associated  with  the 
conduct  of  training  research  and  implementation  of  findings  into  the  Navy's 


on-going  training  programs.  This  is  followed  by  Dr.  Edward  Rundquist's 
account  of  some  of  the  current  exploratory  efforts  being  undertaken  in 
curriculum  development  and  highlights  plans  for  future  research. 

Section  C  consists  of  four  papers  dealing  with  current  research  pro¬ 
jects  and  exploratory  studies  in  the  general  area  of  decision  making.  The 
first,  by  Dr.  Ray  Sidorsky  of  Electric  Boat,  a  division  of  the  General  Dyna¬ 
mics  Corporation,  describes  the  experimental  facilities,  problem  approach 
and  initial  findings  of  his  current  research  program.  The  objective  of  this 
research  is  to  develop  systematic  procedures  and  aids  for  training  personnel 
in  the  area  of  tactical  decision  making.  The  next  paper  by  Dr.  Harold 
Schroder  of  Princeton  University  describes  a  conceptual  orientation  and 
some  research  findings  on  tactical  decision  making.  He  pointed  out  that 
the  research  program  has  potential  implications  for  both  selection  and 
training  of  tactical  decision  makers  at  various  levels  of  command.  The 
third  paper  by  Dr.  R.  M.  Hanes  of  Applied  Physics  Laboratory  summarizes 
the  results  of  dynamic  simulation  studies  leading  to  recommendations  re- 
gardirg  the  role  of  computers  as  tactical  decision  aids  to  the  Fleet  Anti-Air 
Warfare  Commander  in  AAW.  The  fourth  presentation  by  Dr.  Robert  Kinkade 
of  Aircraft  Armaments,  Inc.  briefly  covers  the  results  and  implications 
of  some  of  his  recent  exploratory  studies  in  tactical  decision  making. 

Section  D  consists  of  two  papers  which  present  recently  completed 
research  in  the  area  of  team  performance  and  training.  The  first  by  Dr. 
George  Briggs  of  Ohio  State  University  reports  the  findings  of  a  study  con¬ 
cerning  the  affects  of  altering  various  team  and  task  variables  on  team 
performance.  The  second  paper  is  a  joint  presentation  given  by  Dr.  Robert 
Glaser  and  Dr.  David  Uaus  of  the  American  Institute  of  Research.  Part 
I  of  the  paper  sets  forth  the  methodology  and  approach  taken  to  investigate 
team  behavior  in  a  laboratory  environment.  It  goes  on  to  describe  the 
exploratory  studies  which  demonstrate  the  effectiveness  of  the  laboratory 
environment  as  a  suitable  setting  for  investigating  team  behavior.  The 
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second  part  of  the  paper  summarizes  a  number  of  studies  designed  to  deter¬ 
mine  the  affects  of  such  variables  as  team  composition,  reinforcement 
schedule,  prior  individual  training  and  individual  ability  on  team  performance. 
These  studies  should  provide  a  better  understanding  of  the  factors  that  affect 
team  learning  and  ultimately  toward  the  development  of  effective  team  training 
methods  and  techniques. 

The  last  section  of  the  report.  Section  E,  contains  a  paper  given  by 
Dr.  Joseph  Rigney  of  the  University  of  Southern  California.  It  is  a  product 
of  a  joint  effort  by  Dr.  Glenn  Bryan  of  the  Office  of  Naval  Research  and 
Dr.  Joseph  Rigney.  It  contains  a  proposed  concept  to  handle  several  of  the 
recognized  problems  encountered  in  attempting  to  train  and  maintain  a  high 
degree  of  personnel  readiness  in  the  operational  environment.  This  concept 
was  presented  to  get  reactions  and  suggestions  from  the  various  participants. 
It  is  planned  to  elaborate  and  modify  the  concept  with  continued  exposure 
to  both  operational  and  cognizant  research  personnel. 
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BACKCaoUIfD  FOR  THE  COMFERBIMBI 


Olena  L.  Bryan 

There  are  a  number  of  reaaona  lAiy  this  conference  naa  called: 

1)  to  preridc  an  og^portuaity  for  those  eondueting  reaeweh  related  to  AAM 
to  meet  together^  get  acquainted,  and  open  up  new  chaimels  of  oemBunication; 

2)  to  exchange  research  Informstloa; 

3)  to  Identify  e<»BBon  and/or  critical  prebleaa  of  AAW  training  and/or  train¬ 
ing  research; 

4)  to  invite  each  of  you  to  participate  In  an  Integrated,  cooperative  AAW 
research  program;  and 

$)  to  seek  your  assistance  In  developing  effective  procedures  that  will 

allow  us  to  work  effectively  together  In  prosecuting  that  program. 

That  Is  quite  an  order  for  a  single  two-day  meeting.  However, 

If  this  meeting  la  successful,  It  should  be  the  first  of  a  series  which 

should  contribute  greatly  to  the  achievement  of  these  goals- 

In  order  that  we  eOl  st«trt  out  with  the  sane  background  iBf<»r- 

matlon,  let  us  review  briefly  the  events  which  have  led  up  to  this  meeting. 

Since  this  Is  an  Informal  meeting,  allow  me  to  relate  this  in  the  way  that 

It  happened  from  my  own  point  of  view. 

For  me  it  all  started  about  15  years  ago  id»en  I  had  the  oppMinuil^ 

to  participate  in  a  series  of  studies  that  Included  the  observation  and 

analysis  of  Combat  Information  Centers.  At  that  tiaie  It  became  apparent 

that  the  officers  and  men  who  were  atteiig)tlng  to  counter  the  air  threat 

were  faced  with  a  very  difficult  Job  at  idileh  many  were  inadequate,  ferhaps 

even  worse,  even  though  they  were  aware  of  that  fact,  it  was  nej:t  to 
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impoBBible  for  them  to  get  sufficient  amounts  of  the  right  kinds  of  train¬ 
ing  to  overcome  their  deflclences  for  that  matter,  there  vere  strong 
suspicions  that  appropriate  training  facilities  and  procedures  did  not 
exist.  Even  the  fleet  training  exercise,  the  bulwark  of  durational  team 
training  In  the  Navy,  left  a  great  deal  to  be  desired.  It  was  usually 
difficult  for  certain  of  those  In  CZC  to  know  what  they  were  doing  wrong, 
what  they  were  doing  right,  or  to  know  exactly  vrtiat  they  had  done  when 
the  exercise  was  over. 

Following  that  experience,  the  efforts  of  the  RAND  Corporation 
and  of  the  System  Development  Corporation  to  develop  new  training  facilities 
and  procedures  for  the  Air  Force  In  support  of  their  air  defense  training 
were  watched  with  great  Interest.  These  efforts  entphaslzed  the  Importance 
of  team  training  and  demonstrated  the  effectiveness  of  a  number  of  eigperl- 
mentally-derlved  training  principles.  Furthermore,  esqperlmental  studies 
that  were  being  carried  out  at  the  Naval  Research  Laboratory  and  later  at 
the  Applied  Physics  Laboratory  provided  convincing  proof  that  operations^, 
team  training  could  benefit  from  laboratory  research,  despite  Its  complexity. 

As  a  consequence  of  this  background  I  was  "fair  game"  for  the  Chief 
of  Staff  of  the  Atlantic  Training  Conmand  who  was  seeking  to  attract  more 
resesirch  attention  to  the  problems  of  operational  team  training.  One  Im¬ 
pressive  feature  of  his  Interest  was  that  be  seemed  eager  to  get  psychol¬ 
ogists  to  work  on  real  problems  and  yet  was  willing  to  let  them  attack 
these  problems  In  the  manner  In  which  they  bad  been  trained.  It  is  un¬ 
necessary  to  point  out  to  most  of  you  here  that  this  attitude  Is  not  alto¬ 
gether  common. 

Preliminary  discussions  with  representatives  of  th.e  Training  Conmand 
led  to  the  establishment  of  an  ^  hoc  cajmitte''  Capt  In  A.  L.  '  tpherd, 
CooffraLiuit;  Mr.  Sidney  Friedman,  Bureau  of  Naval  Pers  i -1;  Dr.  James  Regan, 


Naval  Training  Device  Center;  and  the  Commanding  Officer  at  Dam  Neck 
(originally  Captain  Green  and  later  Captain  Balch)  and  myself.  In  order 
to  take  advantage  of  experiences  gained  in  connection  vltb  the  system 
training  program  for  the  Air  Force  and  in  their  ovn  team  training  e:q)erl- 
ments  at  Princeton,  Dr.  John  Kennedy  and  Dr.  Harry  Schroder  were  invited 
to  participate  in  the  series  of  committee  meetings.  Arrangements  for 
their  participation  were  made  through  the  Group  Psychology  Branch  of  the 
Office  of  Naval  Research  \dilch  sponsored  the  Princeton  studies. 

This  committee  reviewed  the  reports  of  ONR  study  groups  and  of 
the  Joint  Atlantic  and  Pacific  Fleet  Symposium  on  AntlAlr  Warfare.  They 
also  entered  into  discussions  with  the  training  personnel  at  Dam  Neck. 

After  several  meetings,  it  was  decided  that  the  situation  warranted  exami¬ 
nation  by  a  full-time  consultant  idio  could  devote  several  days  to  an  an¬ 
alysis  of  present  and  future  team  training  requirements  and  submit  a 
written  report  to  the  committee  containing  his  comments  and  recommendations. 
Dr.  Robert  Chapman  of  Thompson  Ramo  Wooldridge  was  asked  to  serve  in  this 
capacity.  He  spent  several  days  at  Dam  Neck  collecting  Information  and 
then  appeared  before  the  committee  to  present  his  findings  and  recommen¬ 
dations*  This  report  was  submitted  through  channels  by  the  Training  Command, 
Atlantic,  in  order  to  get  reactions  —  and  it  got  some.  Most  of  these  stemm¬ 
ed  from  the  fact  tliat  the  consultant's  report  was  misunderstood  to  be  a 
specific  proposal  as  opposed  to  a  general  approach. 

Consequently,  as  a  member  of  ohe  committee,  I  was  asked  to  pro¬ 
vide  clarification  and  further  details.  To  generate  further  information. 

Dr.  Joseph  Rigney  of  the  Electronics  Personnel  Research  Gx'oup  at  the  Uni¬ 
versity  of  Southern  California  was  asked  to  visit  Dam  Neck  eind  submit  a 
separate  report.  Armed  with  the  report  submitted  by  Dr.  Chapman  and  the 
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report  submitted  by  Dr.  Rlgney;  Mr«  Friedman,  Dr.  Regan,  and  I  net  to¬ 
gether  to  evolve  a  version  of  the  plan  upon  iiblcb  ve  could  all  agree  and 
vhlch  each  would  be  willing  to  back  with  his  own  resources. 

Although  the  resulting  plan  was  not  intended  to  be  any  more  than 
a  specification  of  the  plan  already  submitted  up  tbrou{d>  channels,  It  was 
regarded  as  an  alternative  plan  and  we  were  urged  to  make  It  a  matter  of 
official  record.  This  was  done  by  means  of  a  presentation  to  the  Staading 
Committee  for  Personnel  Training  and  Readiness.  It  was  then  sent  to  the 
Chief  of  Naval  Operations  requesting  that  It  be  reviewed  and  appsroved. 

After  extensive  review,  approval  was  granted  to  laplement  the  first  portion 
of  the  plan  and  ONR  was  asslpied  management  responsibility. 

Before  proceeding  with  a  description  of  the  plan  itself,  I  would 
like  to  discuss  the  guidelines  that  wejre  used  in  laying  It  out*  First  of 
all,  It  should  be  made  clear  that  the  ultimate  goal  of  the  plan  Is  to  Im¬ 
prove  AAW  Readiness.  It  seeks  to  do  this  by  Improving  training  at  all 
levels  of  responsibility,  for  teams  and  for  individuals,  ashore  and  afloat. 
The  plan  Is  to  Inccnrporate  both  basic  and  applied  research.  All  of  the 
research,  basic  as  well  as  applied,  is  to  be  xmdertaken  within  a  frame-work 
such  that  the  potential  contribution  of  each  has  a  specified  relationship 
to  the  program  as  a  whole. 

One  of  the  considerations  which  was  a  matter  of  some  concern 
was  the  cost  of  supporting  the  training  system  that  might  eventuate  from 
future  research.  For,  If  history  has  tau^t  us  anything  about  operational 
team  training  in  this  area.  It  has  tauf^t  us  that  the  costs  of  supporting 
such  training  can  be  quite  high.  Consequently,  It  is  most  important  to 
make  provision  for  adequate  support  of  any  new  training  system  from  the 
outset.  I,  personally  feel  that  many  of  the  current  training  systems 
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suffer  from  the  lack  of  adequate  support.  It  would  he  Indeed  unfortunate 
If  a  new  system  was  developed  and  failed  to  realize  Its  full  potential 
because  Its  support  requirements  had  not  been  foreseen. 

Other  characteristics  related  to  the  support  plan  are  shown  In 
the  accoDq)anylng  slide. 

Desired  Characteristics  of  An 
AAW  Training  Support  Program 

Once  Developed,  It  Should  Be  -- 
Self- sufficient 
Adaptable 

A  Navy-manned,  In-service  program 

Feasible  In  Its  technical,  hardware,  and 
dollar  demands. 

The  decision  to  specify  that  the  training  program  to  be  developed 
should  be  capable  of  being  supported  by  Navy  personnel  was  beuied  upon  knowl¬ 
edge  that  the  Navy  was  unwilling  to  become  dependent  upon  emy  specialized 
civilian  organization.  Many  reasons  were  given  for  this  unwillingness 
irtilch  won't  be  gone  Into  at  this  time.  The  training  system  shoTild  be  self- 
sufficient  enough  to  allow  It  to  function  adequately  even  If  some  other 
system  falls.  It  should  be  sufficiently  adaptable  to  accommodate  great 
changes  —  because  changes  will  occur  over  the  years.  It  should  be  manned 
by  Navy  personnel  and  course  materials  should  be  produced  by  Navy  personnel. 
In  all  aspects  It  should  be  feasible  In  Its  technical,  hardware  euid  doUacr 
demands.  However,  It  should  be  enphaslzed  that  there  Is  a  big  Job  to  be 
done  8uid  It  won't  be  quick,  cheap,  or  easy. 

So  far  we  have  been  talking  about  the  support  required  by  the 
training  program  Itself.  Let  us  now  shift  to  some  consideration  of  the 
research  plan  which  Is  expected  to  produce  a  new  training  program  or  to 
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loqprove  existing  ones. 

A  research  effort  capable  of  doing  this  Is  apt  to  be  reasonably 
large.  It  has  to  be  managed  somehow.  There  seemed  to  be  four  general  ways 
that  such  a  program  could  be  naneiged.  One>  a  contractor  can  be  selected 
and  given  the  responsibility  conducting  whatever  research  was  necessary. 

He  would  be  provided  with  the  funds  necessary  to  support  his  effort.  Two, 
a  kind  of  Special  Projects  organisation  ml^t  be  set  up  and  given  the 
authority  and  the  resources  to  develop  a  new  training  program.  Three, 
the  situation  could  be  left  as  it  is.  After  all,  some  research  related 
to  AAW  gets  done  at  the  present  time.  By  and  large  it  is  good  research, 
conducted  by  competent  people.  However,  It  is  largely  uncoordinated.  It 
isn't  entirely  clecur  how  it  all  fits  together.  This  leads  to  the  fourth 
possibility,  which  Is  to  knit  together  the  efforts  of  the  people  who  are 
capable  of  doing  research  In  the  area,  the  researchers  with  extensive 
backgrounds  and  contacts  within  the  Navy  and  in  AAW.  This  fourth  approach 
would  seek  to  utilize  existing  research  capabilities  and  budgets  to  a 
maximum.  The  purpose  of  this  meeting  is  to  explore  the  possibility  of 
working  out  the  details  of  procedures  for  developing  a  Navywlde  Integrated 
research  program.  The  plan  would  Involve  both  military  and  civilian  efforts, 
in-service  and  contractor,  operators  and  trainers. 

So  much  for  the  guidelines  that  were  agreed  \qpon  as  the  framework 
within  which  the  training  and  the  training  iresearcb  should  be  carried  on. 

Now  to  get  to  the  plan  Itself. 

It  consists  of  9  tasks.  These  are  presented  below. 

.01  Statement  of  Behavioral  Specifications  for  AAW  Training 
.11a  Develop  AAW  Training  Research  Program  Plan 
.Ub  Systems  Analyses  of  AAW  Training  Reijulrements 
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.12  Consider  Implications  of  USAF  Air  Defense  Training  Program 
.13  Develop  Criterion  Measures  of  AAW  (^rational  Proficiency 
.20  Develop  and  Evaliate  Conceptual  Design  for  New  Training 
Materials  and  Methods  in  AAW 

.21  Develop  Support  Material  for  AAW  Operational  Training 
.22  Develop  and  Test  AAW  Student  Selection  and  Classification 
Procedures 

.30  Conduct  Final  Test  and  Evaluation  of  the  Newly-developed 
AAW  Training  Systems 

The  numbers  that  appear  before  the  titles  of  the  tasks  indicate 
the  order  in  \rtiloh  they  should  be  undertaken.  The  fact  that  some  of  them 
have  Identical  first  digits  indicate  that  they  can  be  paralleled.  Each 
task  is  designed  to  produce  useful  Infoarmation  in  its  own  right  in  addition 
to  contributing  to  later  tasks.  Each  task  is  small  enough  that  any  of  the 
funding  organizations  involved  could  accommodate  any  one  of  them  without 
major  reprogramming.  This  division  into  tasks  of  this  size  make  it  re¬ 
latively  simple  for  the  three  funding  groups  to  divide  the  program  up  using 
different  research  groups  and  different  funds. 

It  is  important  to  recognize  that  the  plan  listed  is  a  minimum 
plan.  If  it  is  undertaken,  it  will  contribute  to  the  iniprovement  of 
current  training  and  the  development  of  improved  training  procedures. 
However,  it  is  Intended  to  serve  still  another  function  —  that  of  provid¬ 
ing  a  focus  for  the  many  different  types  of  research  that  are  being  con¬ 
ducted  that  could,  and  should,  have  a  beeurlng  on  AAW  operational  team 
training.  One  way  of  thinking  of  it  is  to  think  of  the  9  tasks  as  vertlbrae 
that  make  up  a  backbone.  The  other  research  may  be  related  to  the  backbones 
as  ribs.  And,  in  that  indirect  way,  the  ribs  become  related  to  each  other. 
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Such  a  structure  permits  those  attempting  to  program  research  to  detect 
gaps  and  note  relationships.  As  we  ^11  learn  dtirlng  the  course  of  this 
meeting,  It  Is  hoped  that  it  will  provide  the  basis  for  a  cooperative 
research  enterprise  of  substantial  proportions. 

The  first  of  the  tasks  listed  has  been  completed.  It  was 
accomplished  by  Dr.  vnilttenbiurg  of  Human  Sciences  Research.  They  are 
currently  continuing  their  work  on  extensions  of  their  original  findings. 

Dr.  Weiss  of  the  MATRIX  Corporation  has  been  pursuing  the  task  Indicated 
as  .11a  for  the  past  several  months.  I  shall  not  attempt  to  describe 
these  tasks  at  this  time  since  they  will  be  presented  in  some  detail  by 
their  Investigators  shortly.  Task  ,11b  is  planned  for  later  this  year  in 
connection  with  the  Naval  Training  Devices  Center's  research  program.  Generally 
speaking,  It  Involves  the  application  of  operations  research  techniques 
to  guide  training  research.  It  seeks  to  Indicate  where  training  research 
Is  most  needed  and  to  guide  the  Investment  of  training  research  dollars 
where  they  will  do  the  most  good. 

Teisk  .12  embodies  one  of  the  \m\asual  features  of  the  plan.  Its 
primary  piurpose  Is  to  set  aside  some  funds  to  obtain  advise  from  those  who 
have  learned  the  lessons  that  the  Air  Force's  experience  had  to  teach. 

But,  In  addition,  it  will  serve  to, pay  consulting  fees  to  any  investigator 
who  needs  assistance  from  a  previous  investigator  in  interpreting  his  re¬ 
ports  or  to  assist  with  the  detailed  planning  for  the  execution  of  some 
foUoH-up  task  taking  full  advantage  of  the  esqperlenced  i^ned  in  the  con¬ 
duct  of  the  previous  research.  Investigators  who  Join  agree, 

in  advance,  to  provide  consulting  assistance  of  this  type  to  other  Investi¬ 
gators.  Where  required  these  consulting  services  will  be  furnish^  by  ONR. 


A-8 


Task  .13  covers  the  development  of  performance  criteria  for  the 
Individual  jobs  Involved  in  AAW  and  for  the  performance  of  the  MW  system 
itself.  With  appropriate  criterion  measurement  techniques,  it  vlll  be 
possible  to  compare  various  methods  of  training.  Hopefully,  it  will  also 
provide  diagnostic  information  which  will  reveal  strengths  and  weaknesses 
of  each  specific  training  procedure. 

Task  .20  seeks  to  develop  in  detail  the  conceptual  design  for  a 
new  training  system.  This  design  can  be  examined  and  evaluated  from 
many  points  of  view  as  a  concept  before  expensive  hardware  is  developed. 

Once  the  conceptual  design  is  perfected  the  next  step  is  the  straightfor¬ 
ward  implementation  of  the  concept. 

Task  .22  may  not  prove  to  be  necessary.  Or,  it  may  simply  be 
a  matter  of  developing  appropriate  standards  for  selecting  individuals 
for  the  various  billets  Involved  in  MW. 

The  last  task  anticipates  the  final  test  and  evaluation  of  the 
training  system,  'nils  Involves  more  than  an  examination  of  its  output. 

It  will  seek  to  examine  thoroughly  the  characteristics  of  the  training 
system,  including  such  things  as  its  capacity,  flexibility,  breakdown 
points,  etc. 

The  Chief  of  Naval  Operations  has  approved  the  plan  for  im¬ 
plementation  through  Task  .13.  I  think  that  it  is  evident  that  the  plan 
is  progressing.  We  will  soon  be  preparing  an  account  of  its  current 
status  for  presentation  to  CNO,  OOMCRAMHT,  OOUCBtlfMi,  and  other  representa¬ 
tives  of  the  military  offices  involved. 

The  ultimate  success  of  the  plan  is  dependent  upon  close  and 
continxied  cooperative  effort  anxmg  people  who  tend  to  be  distinguished 
more  t<xe  jealously  guarded  independence  to  toeir  research  ratoer  toan  for 
their  cooperative  research  efforts.  It  may  be  naive  to  pin  toe  hopes  of 
toe  plan  upon  such  an  unlikely  consideration.  However,  Z  do  not  really 
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think  this  Is  so.  It  seems  to  me  that  achievements  to  date  Indicate 


that  such  an  approach  Is  not  only  feasible  but  veil  on  the  road  to 
realization. 
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Behavioral  Specifications  for  Key  AAW  Personnel 
and  Subteams  in  the  CIC/WCS  Complex  * 

John  A.  Whittenburg 
Human  Sciences  Research,  Inc. 

The  topic  of  my  presentation  is  behavioral  specifications.  In  brief, 
behavioral  specifications  serve  to  describe  the  operational  performance 
characteristics  associated  with  proficient  personnel.  Explicitly  defined 
behavioral  specifications  provide  a  foundation  for  deriving  realistic  training 
objectives. 

With  that  short  introduction,  1  would  like  to  focus  a  number  of  the 
following  remarks  around  Chart  1,  entitled,  "Variable  Domain  for  Behavioral 
Specifications."  This  chart  will  be  used  as  a  basis  for: 

1.  Expanding  the  definition  of  behavioral  specifications. 

2.  Discussing  the  methodological  approach  tsiken  in  this  study. 

3.  Identifying  the  study  scope  and  relative  research  emphasis. 

4.  Introducing  some  of  the  key  concepts  used  in  this  study. 

Inspection  of  the  Chart  reveals  four  descriptive  categories.  Category 
One  (functional  requirements)  deals  with  the  question  of  what  is  the  "job"  to 
be  performed.  Category  Two  (personnel  levels)  is  concerned  with  the  ques¬ 
tion  of  who  performs  the  "job".  Category  Three  (contextual  variables)  deals 
with  the  question  of  where  or  in  what  context  the  "job"  is  to  be  performed. 

Category  Four  (performance  criteria)  is  concerned  with  the  question  of  how 
or  in  what  terms  the  required  performance  may  be  described.  In  substance, 

♦  The  material  used  in  this  presentation  was  taken  from  the  following 
reference . 

Whittenburg,  John  A. ,  Cavonius,  Carl  R. ,  Harper,  Walter  R. ,  and  Bailey, 

Gerald  C.  Behavioral  specifications  for  key  AAW  personnel  and 

subteams  in  the  CIC/WCS  Complex.  McLean,  Virginia:  Human 

Sciences  Research,  Inc.  July  1963.  HSR-RR-63/ 16-Sd  (CONFIDENTIAL) 
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there  are  four  kinds  of  considerations  included  in  the  development  of  a  be¬ 
havioral  specification: 

1.  What  is  the  nature  of  the  "job" 

2.  Who  is  assigned  the  "job" 

3.  What  is  the  "job"  context. 

4.  How  may  the  "job"  performance  be  described. 

Returning  to  the  first  category,  I  would  like  to  discuss  in  somewhat 
more  detail  the  terms  listed  under  functional  requirements.  The  first  term 
listed  is  mission.  Figure  1  shows  an  illustrative  concept  of  an  anti-air 
warfare  area.  Within  a  generically  defined  AAW  mission  context,  at  least 
two  alternative  strategies  are  possible.  The  objective  of  one  strategy  is  to 
maximize  the  probability  of  avoiding  detection  and  contact  with  enemy  air  units. 
The  AAW  effort  is  judged  successful  when  the  primary  mission  (e.g.,  strike, 
amphibious  operation,  etc.)  is  executed  without  the  necessity  of  the  force/ 
group  having  to  engage  enemy  air  units.  The  objective  of  the  second  strategy 
is  to  take  those  actions  which  maximize  the  probability  of  detecting  and  engaging 
enemy  air  units  at  the  greatest  feasible  range  from  the  vital  area  of  the  force. 
This  second  strategy  appears  to  be  the  currently  dominant  strategy  in  AAW. 
Within  the  context  of  this  second  strategy,  the  overall  criterion  concept  adopted 
for  describing  AAW  performance  during  the  engagement  phase  (described  next) 
is  response  time,  i.e.,  the  time  between  initial  detection  and  effective  engage¬ 
ment  of  a  threat.  This  criterion  will  be  reintroduced  later  under  the  problem 
of  selecting  criteria  with  which  to  describe  proficient  performance. 

Figure  2  graphically  portrays  and  relate®  the  next  three  terms  listed 
under  Category  One;  phases,  functions  and  tasks.  This  figure  is  shown  to 
illustrate  three  points.  First,  the  notion  of  descriptive  levels.  At  the  broadest 
level,  a  mission  description  reflects  the  overall  objective  of  AAW.  At  the 
next  level,  a  mission  may  be  divided  into  four  sequential  time  phases,  each 
described  by  a  term  denoting  a  major  sub-objective  of  AAW.  Associated 
with  each  mission  phase  there  are  functions,  and  the  accomplishment  of  each 
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function  involves,  in  some  proportion  and  manner,  the  execution  of  various 
tasks.  This  notion  of  descriptive  levels  provides  a  convenient  frame  for 
identifying,  investigating,  and  relating  AAW  performance  requirements  from 
the  Force  Anti-Air  Warfare  Commander  level,  assigned  mission  responsibility, 
to  a  specific  individual  assigned  a  particular  task.  Second,  the  notion  of  gen¬ 
erality.  The  terms  listed  in  Figure  2  are  generic  terms  and  can  be  used  as 
guides  for  identifying,  comparing  and  relating  the  performance  requirements 
across  different  types  and  classes  of  AAW  units .  In  other  words,  the  functional 
classification  scheme  provides  a  generalizable  frame  on  a  "lateral"  organiza¬ 
tional  basis  as  well  as  on  a  "vertical"  command  basis  just  mentioned.  The 
third  point  refers  to  the  use  of  this  figure  to  indicate  a  major  decision  regarding 
study  scope.  Study  effort  was  confined  to  those  tasks  and  functions  associated 
with  the  engagement  phase  of  the  AAW  mission. 

Figure  3  touches  on  the  question  of  personnel  "job"  assignment,  i.e.. 
Category  Two  of  Chart  1.  Figure  3  illustrates  two  points.  First,  an  attempt 
was  made  to  classify  and  define  personnel  "job"  assignments  by  combining  a 
functional  classification  scheme  (shown  in  Category  One  of  Chart  1)  with  a 
structural  orientation  based  on  the  more  commonly  used  weapon  system 
orientation.  Personnel  assignment  levels  are  depicted  in  Column  1  of  Figure 
3.  A  structural  classification  is  shown  in  Column  2,  and  a  functional  classifi¬ 
cation  is  shown  in  Column  3.  Command  and  Control  level  refers  to  the  Fleet 
Anti-Air-Warfare  Commander  and  his  assigned  Battle  Staff  whose  major 
responsibility  is  the  control  and  allocation  of  all  force  weapon  systems  during 
the  AAW  engagement  phase.  Inter -team  refers  to  a  unit  command  level  (in 
this  case,  PDG-2)  whose  responsibility  it  is  to  effectively  coordinate  the  employ¬ 
ment  of  all  assigned/ installed  weapon  systems  during  an  AAW  engagement. 

Teams  are  organized  around  the  employment  of  specific  weapon  systems. 
Subteams  are  those  in  the  CIC/WCS  complex  assigned  to  accomplish  one  or 
more  of  the  functions  required  in  an  AAW  engagement.  Finally,  individuals 
perform  the  specific  tasks  necessary  to  accomplish  particular  functions. 
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This  personnel  level  notion  will  be  further  elaborated  later  in  the  presenta¬ 
tion.  Second,  Figure  3  illustrates  another  aspect  of  the  study  scope .  Re¬ 
search  effort  was  confined  to  the  DDG-2  class  ship  with  major  attention  given 
to  team,  subteam  and  individual  levels. 

Referring  back  to  Chart  1.  Category  Three  identifies  three  types  of 
contextual  variables.  The  two  classes  of  operational  variables  define  the 
external  requirements  placed  on  an  AAW  system  and  its  personnel.  The  AAW 
system  must  operate  effectively  within  a  specified  environmental  context  in 
countering  the  threat  described  in  terms  of  the  characteristics  of  the  raid. 

The  two  classes  of  variables  assigned  to  the  system  encompass  all  of  the 
hardware  and  software,  and  their  operating  characteristics  associated  with 
the  system  to  which  personnel  are  assigned.  The  design  characteristics  and 
capabilities  of  a  system  largely  dictate  the  system's  operating  procedure. 

For  this  reason,  operating  procedures  are  included  under  the  system  heading. 
The  two  classes  of  variables  assigned  to  the  tactical  heading  deal  with  the 
system's  objective  (specific  mission)  and  how  the  system's  capabilities  should 
be  employed  (doctrine)  to  most  effectively  counter  a  particular  threat  within 
a  given  environmental  context.  Figure  4  summarizes  the  context  within  which 
the  study  effort  was  conducted. 

The  last  category  shown  on  Chart  1  is  concerned  with  the  problem  of 
performance  criteria;  the  fourth  but  extremely  important  component  in  a  be¬ 
havioral  specification.  One  of  the  problems  generally  faced  in  criterion 
development  is  the  selection  of  criteria  which  are  (1)  logically  related  to  some 
overall  concept  of  effectiveness  and  (2)  which  are  useful  for  comparing  in¬ 
dividuals  for  training  or  evaluation  purposes.  It  is  proposed  in  this  study  that 
level  of  proficiency  of  individuals,  subteams  and  teams  is  one  of  the  critical 
determinants  for  selecting  appropriate  criteria.  Specifically,  the  use  of 
diagnostic  criteria  is  most  appropriate  during  the  formative  learning  or 
initial  training  stages.  When  the  personnel  involved  have  attained  a  sufficient 
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level  of  skill  and  knowledge  proficiency  then  the  use  of  a  single  overall  criterion 
measure  of  effectivenss  Is  meaningful.  This  would  suggest  that  such  measures 
as  go/no-go,  accuracy,  time,  completeness  and  quality  are  appropriate  during 
the  initial  learning  stages.  When  application  of  these  criteria  indicate  that 
the  personnel  are  consistently  performing  their  specific  tasks  at  a  satisfactory 
level,  the  use  of  an  overall  measure  of  level  of  proficiency  may  be  adopted. 
Standard  operating  procedures  and  equipment  operating  requirements  may  be 
used  to  provide  the  guidelines  around  which  the  basic  skill  and  knowledge 
requirements  are  developed.  Once  these  requirements  are  met,  variation 
in  procedure  and  technique  may  be  appropriate  for  different  situations  and 
personnel.  To  provide  for  this,  the  criteria  selected  should  be  more  of  a 
"product"  type  of  criteria  rather  than  "process"  type  of  criteria.  The  initial 
selection  of  an  overall  measure  of  operational  effectiveness  was  guided  by 
the  criterion  notion  of  response  time  mentioned  earlier  coupled  with  the  con¬ 
cept  of  the  AAW  system  as  an  information  processing  system.  Within  the 
scope  of  this  study,  the  CIC/WCS  complex  of  the  DDG,  like  that  of  other  units, 
receives  inputs  through  the  ship's  sensors  and  communication  links,  processes 
these  information  inputs,  and  controls  the  ship's  weapon  and  communication 
outputs  in  response  to  the  mission  and  nature  of  the  situation.  Figure  5 
illustrates  this  concept  for  a  single  unit.  A  combination  of  the  "response 
time"  concept  and  the  information  processing  system  concept  suggested  the 
use  of  "information  processing  rate"  or  amount  of  information  processed  per 
unit  of  time  as  the  operational  criterion  by  which  to  describe  the  performance 
of  proficient  individuals,  subteams  and  teams. 

As  a  final  step  preparatory  to  developing  behavioral  specifications, 
it  was  necessary  to  select  key  individuals  and  subteams  from  the  CIC/WCS 
complex  on  which  to  concentrate  attention.  Four  general  considerations  were 
used  to  guide  the  selection.  Using  Figure  6  as  a  graphic  aid,  the  considerations 
are  as  follows: 
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Figure  5 

A  GRAPHIC  ILLUSTRATION  OF  THE  CIC/WC  COMPLEX 
AS  AN  INFORMATION  PROCESSING  SYSTEM 
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1.  To  promote  representativeness,  it  was  judged  important  to 
select  individuals  and  subteams  who  perform  different  tactical  functions 
dur.ng  the  engagement  phase  of  an  AAW  mission. 

2.  To  provide  a  broad  skill  and  knowledge  base,  it  was  desirable 
to  select  individuals  who  perform  tasks  requiring  qualitatively  different 
skills  and  knowledges. 

3.  To  provide  realistic  training  requirements,  it  was  essential 
to  select  personnel  positions  known  to  demonstrate  a  wide  variance  of  pro¬ 
ficiency  among  assigned  personnel.  It  would  be  of  little  value  from  a  training 
point  of  view  to  select  individuals  who  show  little  difference  in  level  of  pro¬ 
ficiency  either  as  a  function  of  equipment  constraints  or  nature  of  the  task 
required. 

4.  To  meet  operational  considerations  it  was  desirable  to  select 
individuals  who  perform  critical  tasks,  i.e.,  tasks  which  significantly 
contribute  to  the  operational  effectiveness  of  the  CIC/WCS  complex  during 
an  AAW  engagement. 

Based  on  these  considerations,  the  following  individuals  and  sub¬ 
teams  were  selected. 

1.  ECM  Subteam 

2 .  Air  Plotter 

3 .  Evaluator 

4.  Air  Intercept  Controller 

5.  Missile  Subteam 

With  respect  to  the  first  consideration,  the  ECM  subteam  performs 
detection,  classification  and  identification  functions.  The  evaluator  is  respon¬ 
sible  for  threat  evaluation  and  weapon  assignment  functions,  and  the  missile 
subteam  performs  the  weapon  employment  and  weapon  assessment  functions. 
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With  respect  to  the  second  consideration,  the  air  plotter's  task  is 
almost  exclusively  a  data  processing  one;  the  evaluator's  tasks  are  primarily 
decision  making  and  performance  monitoring  and  the  AlC's  tasks  are  a  com¬ 
bination  of  the  decision  making,  data  processing  and  equipment  operation. 

Note  that  all  tasks  listed  earlier  in  Figure  2  are  represented. 

With  respect  to  the  third  consideration,  it  was  the  judgment  of  ex¬ 
perienced  shipboard  and  school  personnel  that  wide  difference  in  proficiency 
existed  among  air  plotters,  evaluators  and  AICs, 

With  respect  to  the  fourth  consideration,  the  information  processed 
by  the  air  plotter  is  the  primary  information  source  for  the  evaluator,  and  is 
used  by  both  the  AIC  and  missile  personnel  during  the  initial  stages  of  weapon 
employment.  The  evaluator  is  responsible  for  the  overall  performance  of 
the  CIC/WeS  complex  during  an  AAW  engagement  and  makes  decisions  which 
determine  which  weapon  and  surveillance  capabilities  will  be  employed  against 
what  targets  and  when.  The  AIC  functions  as  the  major  shipboard  link  in  the 
employment  of  CAP,  considered  at  the  present  time  to  be  the  principle  opera¬ 
tionally  ready  AAW  weapon  system. 

The  final  topic  of  my  presentation  briefly  covers  the  procedures  used 
to  investigate  these  selected  individuals  and  subteams  and  what  we  might  label 
as  our  initial  findings.  Figure  7  will  be  used  as  a  guide  in  discussing  procedures 
and  results  obtained  for  each  selected  individual  and  subteam. 

Although  no  particular  emphasis  was  given  to  the  development  of  be¬ 
havioral  specifications  for  the  entire  CIC/WCS  complex,  we  did  construct,  for 
other  reasons,  an  information  flow  diagram  and  also  performed  a  gross  time 
line  analysis  for  the  entire  CIC/WCS  complex  operating  against  an  assumed 
single  600  knot  bogey  heading  directly  at  the  ship.  Realistic  detection,  tracking, 
and  weapon  ranges  for  a  DDG-2  were  used  in  the  analysis.  The  primary  reaison 
for  mentioning  this  effort  is  to  illustrate  one  approach  for  deriving  behavioral 
specifications  appropriate  at  the  unit  level.  This  procedure  may  be  labelled 
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as  the  "outside -in"  approach  or  the  operational  requirement  approach. 

Given  a  particular  set  of  raid  parameters  and  assumed  or  realistic  sensory, 
tracking  and  weapon  capabilities,  how  much  time  is  available  for  various 
weapon  systems  to  respond  to  the  threat.  This  provides  a  maximum  time 
limit  within  which  the  system  must  respond  to  be  effective  against  the  threat. 
Using  the  gross  time  line  analysis,  the  system  has  about  15  minutes  from 
initial  detection  until  the  bogey  is  overhead.  From  initial  detection  until  a 
CAP  weapon  system  is  normally  ordered  to  break  contact  with  the  bogey  (to 
facilitate  acquisition  and  tracking  by  the  missile  system)  there  is  about  8  to 
8  1/2  minutes  available.  From  the  time  that  the  missile  system  can  acquire 
the  bogey  until  the  bogey  is  beyond  missile  firing  limits,  there  is  about  5  to 
5  1/2  minutes  available.  This  approach  may  be  viewed  as  generating  mini¬ 
mum  acceptable  behavioral  specifications  for  any  given  raid  situation. 

An  "inside -out"  or  system  operating  capability  approach  was  used 
to  provide  an  initial  behavioral  specification  for  the  missile  subteam.  Manu¬ 
facturers'  specifications  for  the  expected  equipment  performance  were  used 
initially  as  a  base.  Standard  operating  procedures  written  as  part  of  individual 
ships  doctrines  modified  upwards  these  initial  estimates.  Individuals  with 
operational  experience  in  the  Tartar  system  were  interviewed  in  addition  to 
technical  specialists  in  the  schools.  Finally,  reports  of  the  Operational  Test 
and  Evaluation  Force  were  examined.  Based  on  these  sources,  the  resulting 
estimate  of  56  seconds  was  derived  as  presenting  the  best  available  estimate 
of  the  response  time  capability  of  the  missile  subteam  to  process  a  single 
bogey  through  the  system  and  to  evaluate  the  results  of  the  engagement  at 
maximum  missile  range.  It  might  be  noted  that  altering  equipment  capabilities 
or  SOPs  can  lenthen  or  shorten  the  time  estimates.  Using  current  estimates 
of  equipment  capabilities  and  current  SOPs  this  figure  represents  about  the 
shortest  time  that  the  missile  subteam  can  completely  process  a  bogey 
and  evaluate  the  effectiveness  of  the  weapon  engagement  at  the  maximum 
tnissile  range. 
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The  ECM  subteam  operating  in  a  passive  intercept  situation  represents 
still  another  method  or  procedure  for  arriving  at  a  behavioral  specification. 

A  training  instruction  source  was  used  as  the  basis  for  specifying  an  informa¬ 
tion  processing  rate  which  can  be  achieved  by  a  proficient  ECM  subteam. 

The  training  situation  described  in  this  source  is  quite  similar  to  the  simple 
passive  intercept  situation  investigated  in  this  study.  Our  study  indicates 
that  an  estimated  50  major  data  processing  steps  should  be  performed  between 
initial  detection  to  a  DF  fix  and  final  evaluation  (involving  coordination  among 
several  ships),  and  the  training  document  specifies  that  these  steps  should  be 
accomplished  within  seven  minutes  or  less  to  be  judged  as  satisfactory.  It 
should  be  noted  that  the  situation  under  which  the  training  exercise  is  conducted 
is  in  the  Hampton  Area  (Norfolk)  and  presumably  under  nearly  ideal  conditions 
with  the  radiating  source  operating  continuously  or  at  frequent  intervals . 

An  experimental  effort  was  undertaken  to  develop  a  behavioral  speci¬ 
fication  for  the  air  plotter.  The  reported  differences  in  level  of  performance 
expected  from  proficient  adr  plotters  served  as  one  of  the  major  reasons  for 
conducting  an  experimental  test.  To  accomplish  this,  it  was  decided  to  simu¬ 
late  a  conventional  CIC  plotting  situation  in  which  plotters  record  the  progress 
of  an  air  exercise  upon  a  vertical  air  summary  plot,  receiving  their  inputs 
from  a  radar  operator  and  the  RCO.  An  engagement  was  prepared  during 
which  as  few  as  four  and  as  many  as  twelve  air  targets  each  minute  were 
reported  to  the  plotter  to  be  entered  bn  his  board.  Ranges  and  bearings  of  these 
targets  were  tape  recorded  in  the  manner  in  which  a  radar  search  operator 
or  radar  tracker  would  relay  this  information  during  an  actual  raid.  In 
addition,  contact  designation,  composition,  altitude,  eng?igement  by  CAP  or 
missiles  and  other  amplifying  information  was  added  to  the  recording,  as  if 
given  by  the  RCO.  In  order  to  make  the  presentation  as  normal  as  possible, 
the  simulated  radar  targets,  which  consisted  of  bogeys  and  CAP,  were  advanced 
along  reasonable  flight  paths  and  at  conventional  airspeeds.  The  test  lasted 
nine  minutes  and  nine  air  plotters  with  varying  amounts  of  prior  training  and 
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experience  served  as  subjects.  The  results  of  the  test  showed  that  the 
proficient  air  plotter  is  capable  of  plotting  accurate  positions  about  75%  of  the 
time  when  presented  with  12  contacts  per  minute.  A  somewhat  more  unam¬ 
biguous  way  of  expressing  this  is  in  terms  of  information  bits  per  minute. 

The  proficient  air  plotter  is  capable  of  processing  about  48  bits  of  information 
per  minute  assuming  an  average  of  4  bits  of  information  is  required  to  completely 
describe  a  track  with  associated  amplifying  information. 

An  experimental  investigation  was  also  conducted  with  the  AIC.  Two 
forms  of  control  are  generally  recognized:  broadcast  control  and  close 
control.  In  the  former,  the  controller  transmits  information  about  bogey 
position,  altitude  and  movements  to  the  CAP  pilot  or  RIO,  who  is  responsible 
for  planning  his  own  intercept.  Since  this  information  need  only  be  given  at 
one  minute  intervals,  the  average  controller  can  pursue  up  to  six  intercepts 
simultaneously.  Close  control,  with  conventional  equipment  and  aids,  usually 
involves  controlling  a  single  CAP  at  one  time.  The  AIC  must  plan  the  inter¬ 
cept  and  provide  the  pilot  with  all  changes  of  heading,  altitude  and  airspeed. 

With  the  advent  of  the  NTDS  system,  it  is  anticipated  that  the  AIC  will  be  able 
to  close  control  more  than  one  CAP  at  a  time,  and  possibly  for  the  very 
proficient  controller,  up  to  six  CAPs  simultaneously.  Success  in  close  con¬ 
trol  intercepts  is  currently  defined  by  the  rather  stringent  criterion  that  at 
the  end  of  the  run,  the  bogey  be  no  more  than  2. 5.  miles  distant  and  within 
20°  of  the  CAP'S  heading. 

One  of  the  major  reasons  for  running  the  experimental  test  was  based 
on  the  anticipation  that  "time  to  intercept”  would  be  a  fairly  sensitive  criterion 
measure  of  proficiency  and  one  logically  related  to  the  criterion  concept  of 
response  time .  However,  with  the  eventual  operational  integration  of  NTDS, 
a  possibly  more  useful  measure  of  overall  proficiency  might  be  the  number  of 
CAPS  that  can  be  close  controlled  simultaneously. 
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The  experimental  test  duplicated  the  actual  intercept  as  closely  as 
possible.  Radar  simulators  of  the  AN/SPS-T2A  type  were  used.  Five 
different  intercept  situations  were  selected.  Three  AIC  instructors  and  four 
less  experienced  AICs  served  as  subjects.  Unfortunately,  the  simulators 
were  found  to  not  run  at  constant  enough  speeds  to  make  the  measure  of 
"time  to  intercept"  meaningful.  However,  using  the  intercept  success 
criterion  mentioned  above,  the  instructors  did  as  well  as  or  better  than  the 
students.  For  the  present,  the  "success"  criterion  remains  the  primary 
measure  of  AIC  proficiency  with  the  current  school  requirement  that  20  out  of 
20  successive  intercepts  meet  this  criterion  standard  in  order  for  the  AIC 
to  be  considered  highly  proficient. 

The  study  effort  devoted  to  the  evaluator  was  in  the  nature  of  a  pilot 
study.  Since  it  was  not  possible  to  define  standards  of  performance,  when 
the  evaluator's  job  has  no  standard  definition,  the  pilot  study  examined  those 
aspects  of  the  evaluation  process  which  conceivably  may  become  performance 
standards.  It's  immediate  objective  was  to  identify  some  of  the  cognitive 
properties  of  the  evaluator's  job  and  to  experimentally  measure  relationships 
between  these  properties  in  the  conduct  of  a  series  of  situational  tests.  An 
attempt  was  made  to  characterize  the  evaluator's  utilization  of  various  informa¬ 
tion  inputs  in  relation  to  the  time  and  quality  of  his  decision  outputs. 

Four  measures  were  obtained  during  the  conduct  of  the  situational 

tests. 

1.  Identification  of  Critical  Inputs;  The  ability  to  recognize  signifi¬ 
cant  aspects  of  a  raid  on  the  basis  of  the  limited  information  available  in  the 
displays  (i.e..  Air  Tote.  CAP  Status,  E/W  Status,  Weapons  Assignment  and 
Vertical  Summary  Plot).  It  involves  an  association  between  displayed  informa¬ 
tion  and  knowledge  of  enemy  capabilities  and  tactics. 
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2.  Identification  of  Critical  Own  Forces  Capabilities;  Success  along 
this  dimension  depends  upon  both  an  adequate  grasp  of  the  tactical  situation 
and  knowledge  of  one's  own  weapon  status  and  capability.  The  capability  for 
matching  own  equipment  characteristics  with  opportunities  to  use  the  equip¬ 
ment  demonstrates  the  extent  to  which  the  individual  can  effectively  use  the 
information  he  processes. 

3.  Quality  of  Command  Decision;  This  decision  is  defined  as  the 
response  to  the  experimental  question,  "What  action  would  you  take  as  the 
evaluator  in  the  given  situation?"  Decision  may  include  responses  such  as 
initiation  of  communications  or  change  in  disposition  of  forces  or  no  immediate 
action.  Quality  of  decision  was  defined  on  the  basis  of  the  expert  judgment  of 
CIC  instructors. 

4.  Decision  Time;  The  length  of  time  from  initial  exposure  of  a 
situation  display  to  the  transmission  of  a  decision  by  the  subject  was  defined 
as  decision  time. 

Ten  synthetic  tactical  problems  presented  on  slides  were  used  in  the 
pilot  study.  Eighteen  officers  on  active  duty  participated  in  the  study.  These 
officers  had  received  training  in  AAW  evaluation,  had  experience  as  evalua¬ 
tors,  or  were  in  a  position  aboard  ship  in  which  they  might  be  called  upon  to 
serve  as  evaluator,  or  possessed  any  combination  of  these  qualifications. 

The  findings  showed  that  the  relationship  between  decision  time  and 
quality  of  decision  was  found  to  vary  as  a  function  of  the  situation.  As  situa¬ 
tion  complexity  or  deceptiveness  increeused,  decision  quality  increased  with 
the  length  of  time  used  to  arrive  at  the  decision.  In  other  so-called  standard 
(less  complex)  situations,  the  faster  the  decision  the  better  the  quality. 

The  significant  relationships  between  measures  of  critical  Inputs 
and  decision  quality,  and  critical  own  forces  capabilities  and  decision  quality 
indicates  that  the  decision  process  involves  two  independe  sources  of 
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variance  whose  combined  variance  accounts  for  almost  two -thirds  of  the 
variance  in  the  subjectively  measured  decision  quality.  Pending  further 
study  of  the  evaluator,  these  two  decision  process  criteria  may  be  used  as 
intermediate  criteria  for  estimating  evaluators'  job  proficiency,  or  probably 
more  useful  as  diagnostic  measures  of  the  knowledge  and  skills  possessed 
or  not  possessed  by  the  evaluator. 

Present  research  effort  is  primarily  aimed  at  a  continuation  and 
expansion  of  the  exploratory  work  performed  in  the  evaluator  area. 
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PROCEDURES  AND  RESEARCH  PLANNING  FOR  ANTIAIR 
WARFARE  TRAINING  PROGRAM* 

Ed  Weiss 

The  Matrix  Corporation 
METHODOLOGY 

The  rather  broad  scope  of  the  study  made  evident  the  need  for  an  ap¬ 
proach  which  would  describe  the  shortest  possible  route  to  the  desired  end 
products.  Several  techniques  for  describing  the  AAW  man-machines  system 
were  considered.  These  included  the  use  of  equipment  task  analyses,  opera¬ 
tional  sequence  diagrams,  and  a  technique  developed  and  used  by  Matrix 
personnel  referred  to  as  the  systems  approach. 

The  systems  approach  was  considered  to  offer  several  advantages  over 
the  other  techniques.  First  and  most  importantly,  the  systems  approach,  un¬ 
like  the  other  approaches,  makes  no  demands  in  terms  of  the  specificity  of 
performance  units.  Since  it  is  an  iterative  technique,  the  ultimate  descrip¬ 
tion  which  it  provides  is  only  as  specific  as  it  need  be  to  achieve  the  end  pro¬ 
ducts.  It  can  be  seen  that  this  approach  is  considerably  different  than  the 
other  techniques  cited,  since  the  latter  require  performance  description  at 
the  task  level,  by  definition.  A  description  of  the  AAW  system  down  to  the 
task  level  of  specificity  is  not  considered  feasible  for  this  study.  Secondly, 
the  systems  approach  results  in  an  integrated  description,  whereas  the  other 
techniques  result  in  descriptions  of  discrete  portions  of  the  system  (or  sub¬ 
system)  which  ultimately  must  be  conjoined  if  total  system  conceptualiza¬ 
tion  is  required.  Third,  the  systems  approach  is  not  constrained  in  any  way 
by  specific  equipment  configurations,  as  is  the  case  with  other  techniques. 

This  is  particularly  advantageous  in  regard  to  this  study  because  of  the 
heterogeneity  of  equipments  used  within  AAW,  and,  further,  because  of  the 
changes  in  equipments  which  can  be  anticipated  in  the  near  future. 

♦The  material  used  in  this  presentation  was  taken  from  the  following 
reference . 

The  Matrix  Corporation.  Procedures  and  Research  Planning  for  Antiair 

Warfare  Tradning  Program:  An  Interim  Report.  Arlington,  Va. : 

The  Matrix  Corporation,  22  November  1 963 .  (Contract  No.  N61339- 

1445,  Project  No.  7596-1)  CONFIDENTIAL 
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The  essence  of  the  systems  approach  utilized  for  this  study  is  a 
basic  requirements  orientation.  In  brief,  it  is  predicated  on  these  assump¬ 
tions:  any  arrangement  of  men  and  machines  must  provide  for  the  accomplish¬ 
ment  of  certain  functions;  and,  in  order  to  demonstrate  satisfaction  of  this 
requirement,  all  performances  by  either  man  or  machine  must  be  couched 
in  concrete,  measurable  terms.  Such  criteria  constitute  not  only  objective 
definitions  of  sjetem  performance  but  also  realistic  behavior  goals  for  training. 

Plan  of  Work 

The  foregoing  systems  approach  was  applied  in  the  generation  of  the 
work  plan  for  this  project  as  shown  in  Figure  1.  The  requirements  or  func¬ 
tional  orientation  (ratherthan  a  means  orientation)  is  indicated  by  the  fact 
that,  while  all  successive  Input-output  states  in  the  diagram  are  defined, 
the  means  by  which  the  various  input-output  tramsductions  are  accomplished 
are  not  specified  but  merely  implied.  The  arrows  shown  in  the  diagram  in¬ 
dicate  the  performance  requirements  in  terms  of  the  various  input-output 
relationships.  A  box  locates  the  point  at  which  a  transduction  is  required  to 
translate  a  given  input  state  of  affairs  into  the  required  output.  The  circles 
on  the  diagram  depict  those  points  at  which  the  system  is  provided  with 
readouts  or  meters  for  the  purposes  of  performance  assessment  and  trouble¬ 
shooting.  In  this  particular  case  they  represent  reviews  with  the  contract 
technical  monitor  and  the  AAW  training  research  team.  Each  such  circle 
implies  a  feedback  line  for  retrofit  of  the  project  as  appropriate,  although 
these  lines  are  not  indicated  on  the  diagram. 

Figure  1  diagrams  the  worksteps  required  for  the  study  as  follows: 
analysis  of  the  AAW  system  (Boxes  1,  2,  and  3  in  the  figure),  description 
of  the  means  whereby  AAW  tradning  is  current  accomplished  (Box  4),  re¬ 
view  of  those  aspects  of  training  research  corresponding  to  the  human  per¬ 
formances  exhibited  in  the  system  (Box  5),  and  the  generation  of  the  long 
range  research  and  shorter  range  developmental  end  products  previously 
described  (Boxes  6  and  7). 
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Use  of  Information  Flow  Model 

Previous  research  (3)  has  indicated  that  the  functions  necessary 
to  the  AAW  system  are:  surveillance,  detection,  classification,  iden¬ 
tification,  threat  evaluation,  weapons  assignment,  weapons  employ¬ 
ment,  and  kill  assessment.  These  functions  constitute  the  basis  for 
analysis  of  the  AAW  system  in  this  project. 

The  primary  functions  of  AAW  are  equivalent  to  the  functions  per¬ 
formed  in  the  CIC  area,  namely:  the  gathering,  display,  assessment, 
and  dissemination  of  information  (24).  Although  the  means  employed 
for  the  accomplishment  of  these  functions,  and  the  procedures  estab¬ 
lished  for  utilization  of  these  means  may  vary  widely  both  within  and 
across  ship  types  (30,  31,  32,  33),  the  essential  system  characteristic, 
an  information  processing  effort,  is  manifest.  It  appears,  therefore, 
that  the  most  suitable  model  for  describing  the  AAW  system  is  an  in¬ 
formation  flow  model.  Such  a  model  offers  several  major  advantages. 
First,  it  spotlights  the  nature  of  the  tactical  data  flow  which  is  the 
essence  of  AAW.  Second,  it  provides  a  criterion  for  excluding  behav¬ 
iors  which  are  necessary  to  AAW  but  which  in  terms  of  training  can 
best  be  assigned  to  other  areas,  such  as  ship  maneuvering,  pilot  per¬ 
formance,  etc.  Third,  all  positions  which  are  made  explicit  by  the 
tactical  data  flow  model  will  only  be  defined  in  terms  of  AAW  perform¬ 
ances.  Thus,  the  evaluator  is  described  in  terms  of  the  decisions 
which  he  makes  and  other  behaviors  which  he  may  evoke,  in  regard  to 
AAW  only.  It  should  be  noted  that  this  provides  a  sharp  demarcation 
from  other  systems  similarly  described  such  that  the  various  inter¬ 
faces  can  be  easily  established.  For  example,  an  important  finding 
might  derive  from  the  fact  that  because  of  the  importance  of  interac¬ 
tion  effects,  higher  echelon  decision  making  behaviors  for  AAW  and 
ASW  should  be  trained  simultaneously. 

The  next  section  of  this  report  describes  the  work  accomplished 
to  date. 
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WORK  ACCOMPLISHED 

The  project  Is  in  its  early  stages.  The  primary  focus  of  the  effort 
to  date  has  been  in  the  area  of  system  description  (Boxes  1,  2,  and  3  of 
Figure  1).  The  paragraphs  that  follow  summarize  the  work  accom¬ 
plished  thus  far  in  this  area, 

AAW  System  Description 

The  section  on  methodology  stated  that  the  AAW  system  delimited 
to  key  areas  and  viewed  as  an  information  processing  system,  would 
be  described  in  a  particular  diagrammatic  form.  The  material  on 
which  this  description  is  based  includes  NWP's  and  NWIP's  (23,  24, 

25),  earlier  research  and  descriptive  efforts  (3,  22,  27,  29),  current 
ship  CIC  procedures  (30,  31,  32,  33),  and  fleet  operations  orders  (1), 
and  observation  of  simulators  at  Naval  training  facilities  as  well  as 
interviews  with  Naval  personnel.  To  date,  sufficient  information  has 
become  available  to  generate  preliminary  descriptions  of  the  convenr 
tional  CIC  (Figure  2),  the  CAP  subsystem  (Figure  3),  the  missile  sub¬ 
system  (Figure  4),  and  the  passive  EW  subsystem  (Figure  5).  Further 
information- gathering  efforts  are  required  for  the  generation  of  mater¬ 
ials  on  NTDS,  and  on  the  gunnery  subsystem,  as  well  as  for  validation 
and  completion  of  the  diagrams  shown  in  the  Figures. 

The  diagrams  shown  are  felt  to  be  useful  in  themselves  as  products 
for  the  following  reasons: 

1.  They  define  and  delimit  the  AAW  system. 

2.  They  allow  for  an  analysis  of  the  primary  functions  required 
by  the  system  regardless  of  the  ship  type,  manning  levels, 
or  onboard  equipments. 

3.  They  show  the  interactions  which  exist  among  these  functions. 

4.  They  allow  for  the  derivation  of  hiunan  performances  in  mean¬ 
ingful  system  terms. 
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5.  They  assist  in  the  generation  of  appropriate  criteria  for 
training  development  and  evaluation. 

6.  They  permit  a  ready  establishment  of  the  interfaces  with 
other  systems  such  as  ASW, 

7.  They  provide  a  source  of  documentation  for  future  work 
efforts. 

The  diagrams  under  discussion  illustrate  pictorially  the  operator 
positions  considered  to  be  key  AAW  jobs.  ^  It  was  felt  that  another 
way  to  consider  these  positions  might  be  in  terms  of  numbers  of  in¬ 
cumbents,  since  this  would  allow  judgments  to  be  made  on  such  topics 
as  cost  versus  criticality  versus  impact  for  a  given  research  area. 
Table  I  shows,  for  combatant  vessels  only,  the  Condition  I  numbers 
of  incumbents  in  AAW.  It  can  be  seen  that  the  system  is  extensive  in 
terms  of  operators.  ^ 

AAW  Training  Description 

An  effort  directed  at  description  of  current  AAW  training  (Box  4 
of  Figure  1)  has  begun.  The  effort  includes  the  locations  at  which 
training  is  administered,  the  type  of  trainin-;  involved  (team  or  indi¬ 
vidual),  and  the  training  techniques  used  (lecture,  simulator). 

Table  II  summarizes  results  to  date  in  this  effort.  The  chief  sources 
of  data  for  the  table  consist  of  interviews  with  on-site  instructor  per¬ 
sonnel  and  BuPers  representatives,  reviews  of  curricula  lesson  guides, 
lesson  plans,  and  handout  material  currently  in  use  (4,  5,  6,  7,  8,  9, 
10, ,  11,  12,  13,  14,  15,  16,  17),  plus  observations  by  the  researchers 
of  training  in  progress. 


^For  another  discussion  of  key  AAW  positions,  see  (3).  (9)  con¬ 
tains  handout  materials  describing  a  typical  cruiser-type  CIC  opera¬ 
tion,  and  commenting  on  the  contribution  of  each  operator  position. 

From  discussions  with  BuPers  representatives,  August  1963. 
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Behavioral  Classification  Scheme 

A  scheme  for  classifying  in  behavioral  context  the  performances 
taught  in  AAW  training,  and  required  for  operation  of  the  AAW  system, 
is  required  as  an  entry  point  to  the  literature  of  training  research. 
Various  classification  schemes  were  considered  for  this  purpose  and 
it  was  finally  decided  to  utilize  the  one  proposed  by  Lumsdaine  (21) 
which  was  cited  and  modified  by  Parker  and  Downs  (26).  The  follow¬ 
ing  version  is  suitable  for  present  purposes: 

1.  Learning  Identifications.  This  category  refers  to  identifying 
objects  in  terms  of  their  appropriate  nomenclature,  locating 
and  relating  them  functionally.  It  includes  the  acquisition  of 
factual  knowledge. 

Example:  Identifying  the  various  controls  associated 
with  a  PPI  display. 

2.  Learning  Perceptual  Discriminations.  This  category  in¬ 
volves  the  integration  of  the  various  sensory  inputs  to  pro¬ 
vide  for  meaningful  resolution. 

Example:  Discrimination  of  a  signal  on  a  PPI  display. 

3.  Understanding  Principles  and  Relationships.  This  category 
refers  to  the  essence  of  the  valid  reasoning  process  as 
demonstrated  by  the  ability  to  state,  illustrate,  and  recog¬ 
nize  the  implications  of  a  relationship  and  the  underlying 
principles  on  which  it  is  based. 

Example:  A  knowledge!  of  the  principles  underlying 
digital  devices. 

4.  Learning  Procedural  Sequences.  This  category  refers  to 
carrying  out  operational  sequences  which  may  relate  to  hard¬ 
ware,  tactics,  the  more  mechanical  mathematical  manipula¬ 
tions,  etc. 

Example:  Voice  communications  procedures  or  equip¬ 
ment  activation  procedures. 


A-51 


CONFIDENTIAL 


CONFIDENTIAL 


5.  Making  Decisions  (Choosing  Courses  of  Action).  This  cate¬ 
gory  Involves  deciding  upon  appropriate  course(s)  of  action 
for  a  complex  situation  where  proceduralized  alternatives 
are  not  available.  It  can,  however,  also  include  the  selec¬ 
tion  of  the  most  satisfactory  procedural  sequence  as  well  as 
the  critical  temporal  decision  of  when  to  respond. 

Example:  Selection  of  the  appropriate  counter -threat 
system, 

6.  Performing  Skilled  Perceptual  Motor  Acts,  This  category 
refers  to  the  integration  of  "discrete"  responses  into  smoothed 
"continuous"  outputs.  Frequently,  several  simple  skills  may 
have  to  be  integrated  themselves  to  form  a  more  complex 
skill. 

Example;  Writing  backwards  to  display  information  from 
the  rear  of  a  plot  board. 

The  foregoing  classification  scheme  with  appropriate  elaboration 
for  specific  performance  categories  appears  to  provide  a  convenient 
technique  for  interrogating  the  literature  and  other  sources  in  order  to 
derive  long  range  research  hypotheses.  However,  it  does  not  provide 
a  satisfactory  link  to  the  information  flow  models  used  to  describe  the 
AAW  system.  In  order  to  account  for  this  discrepancy,  it  was  decided 
to  superimpose  another  classification  which  would  group  the  behavioral 
categories  in  information  flow  terms.  Since  the  items  in  this  classifies 
tion  are  self-explanatory,  they  are  presented  below  without  further  elab 
oration: 

1.  Data  Collection 

2.  Message  Formulation 

3.  Message  Transmission 

4.  Information  Storage 

5.  Information  Retrieval 
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6.  Data  Processing 

7.  Mode  Select  (Distinguishes  decisio.^-’  lakii^  outputs 
from  proceduralized  responses. ) 

8.  System  Responses 


Table  II  presents  an  example  of  the  application  of  this  classification 
scheme  for  one  position — the  Air  Search  Operator.  This  table  is  re¬ 
quired  as  the  output  of  Box  4  in  Figure  1 .  It  will  be  completed  for  the 
other  A  AW  battle  duty  stations  as  part  of  the  future  work  effort. 

The  data  presented  in  Table  II  reflect  the  fact  that  present  training 
as  conducted  by  BuPers  schools  is  oriented  toward  Rates  rather  than 
functions.  ^  In  the  case  of  the  Air  Search  Operator,  the  incumbent  will 
have  attended  the  Class  A  or  B  schools  specified  only  if  he  has  a  Radar - 
man  Rate. 


The  comprehensive  list  of  battle  duty  stations  which  will  be  covered 
for  the  conventional  CIC  is  shown  below.  A  similar  list  will  be  generated 
for  NTDS  equipped  ships. 


Air  Search  Operator 
♦Tracker 

♦Height /Size  Operator 
Long  Range  Plotter 
Air  Summary  Plotter 
♦Bogey  Tote  Keeper 
♦CAP  Status  Board  Keeper 
CID  Net  Talker 
RCO 

AC  Net  Talker 
AIC/AAIC/AIC{S) 

♦♦CA  Net  Talker 


♦GLO 

♦♦WLO 

♦♦TSTC  Operator 
♦*DAC  Operator 
♦♦WAC  Operator 
♦♦WCO 

Intercept  Search  Operator 
♦ECM  Board  Keeper 
♦Jitiiimei'  Operator 
ECM  Officer /EWO 
Evaluator 


♦Position  not  manned  if  function  peifformed  by  other  team  member. 
♦♦Position  manned  if  SAM  Ship. 


T 


From  interviews  with  BuPers  representatives,  November  1963. 
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CONFIDENTIAL 


C»0»)IIUXI0N  REQUIBEMBIirs  FOR  THE  AM 
TRAINIMO  RE3SARCH  PUN 

John  A.  Nagay 

As  has  been  pointed  out  eeurlier,  four  alternative  approaches 
are  available  to  research  planners  attempting  a  research  attack  on  some 
broad  operational  training  front,  like  AAW  or  ASW.  They  are:  (l)  a 
monolithic  contract  structuza,  as  exemplified  by  the  RAND  Oerporatlon, 

(2)  a  monolithic  in-service  or  combination  of  in-service  and  contract 
structure  headed  by  a  program  manager,  (3)  a  laissez-faire  ipproaeb  in 
Yrtilch  the  Independent,  unintegrated,  discrete  research  effwts  that 
exist  today  are  left  to  go  their  separate  ways,  and  (k)  a  kind  of  ”team- 
of-professlonals"  approach  vblch  Includes  some  of  the  features  of  the 
first  three. 

The  latter  approach  appears  to  be  the  most  feasible  to  apply 
to  the  AAW  training  research  plan  under  discussion  here  today.  It  ulU 
not  be  a  monolithic  structure.  Rather,  it  vlU  consist  of  a  numlber  of 
relatively  Independent  research  efforts,  funded  from  several  sources, 
but  knit  into  a  well- coordinated  team  aiproach  to  training  research. 
Althoui^,  it  will  be  a  program  built  out  of  bits  and  pieces,  it  should 
behave  as  if  it  were  unitary.  Insofar  as  this  can  be  done,  it  will  be 
accomplished  through  effective  coordination.  To  be  a  genuinely  integrated 
program  each  task  associated  with  it  must  be  undertaken  with  specific 
reference  to  an  existing  laaster  plan  and  with  detailed  knowledge  about 
the  other  efforts  that  aure  underway.  Collaborative  research  planning 
would  appear  to  be  worthy  of  greater  pcpul  ity.  In  any  case,  it  seems 
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most  desirable  to  evolve  more  effective  methods  for  integrating  the 
nwiy  different  research  projects  that  are  underway.  And,  it  seems 
sensible  to  do  this  within  specific  problem  areas,  such  as  AAW  training. 

It  appears  that  there  will  be  coordination  requirements  re¬ 
gardless  of  the  form  the  AAW  training  research  progrcun  ultimately  takes. 
Coordination  ean  make  essential  contributions  to  the  more  general  goals 
of:  (a)  relating  the  separate  training  research  efforts  to  ea^  other, 

(b)  euicoiqpllsblng  the  desired  research  with  a  minimum  of  interference 
with  on-going  operational  AAW  training,  and  (c)  welding  the  administrative 
and  research  groups  into  an  effective  working  team. 

How,  it  is  very  easy  to  talk  about  coordination  in  some  vague 
general  sense.  However,  as  we  all  know,  coordination  is  more  than  an 
air  of  camaraderie,  a  good-hearted  willingness  to  coc^rate  if  called 
upon  to  do  so.  Hy  purpose  at  this  Juncture  is  to  specify  some  of  the 
functions  of  coordination. 

The  first  of  these  is  the  information  function.  This  includes 
the  exchange  of  formal  and  informal  information  among  the  participants. 
Hopefully,  each  participant  will  feel  obligated  to  get  Information 
about  his  own  work  into  the  hands  of  each  of  the  ol^r  participants. 
Further,  he  should  feel  obliged  to  read  and  understand  the  relevant 
work  being  aceonq)llsbed  by  the  other  meidiers  of  the  team. 

Of  course,  there  are  many  other  ways  that  infonnatlon  exchange 
can  be.  fostered.  This  meting  is  one  way.  Other  metlngs  are  anticipated. 
The  group  has  been  invited  to  visit  other  labwatories  to  see  their 
facilities  first  hand.  Another  possibility  is  a  newsletter  to  call 
attention  to  relevant  work  and  report  progress.  A  less  fonnal  device. 
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such  as  a  round  rol9in  letter  night  prove  very  useful.  I  an  sure  that 
you  could  suggest  others. 

The  Information  function  also  entails  storage  and  reti^evai* 
Because  some  Information  specific  to  AAW  is  net  generally  available, 
a  central  repository  of  such  Information  Is  desirable.  Access  to  It 
could  he  by  request  for  some  specific  Item  of  information  or  for  the 
I06U1  of  a  peurtlcular  document.  In  many  cases,  the  kind  of  Information 
needed  by  AAW  research  is  classified.  This  of  course  con^icates 
matters.  In  those  Instances  idiere  the  Information  cannot  be  made 
available  to  each  and  every  researcher,  the  possibility  exists  that 
the  central  repository  could  serve  as  a  reference  library  for  those 
fortiuiate  to  be  In  Its  vicinity.  In  any  ease,  there  should  be  at  least 
one  place  that  vovQd  contain  copies  of  all  of  the  relevant  information. 

Such  a  central  repository  could  be  drawn  iqon  to  prepare 
reports  of  the  total  endeavor.  This  would  not  only  hold  down  the 
reporting  requirements  for  separate  contractors,  but  would  pxvsent 
a  more  coherent  account  of  the  program  to  those  Interested  In  the 
program^  progress. 

Zn  a  similar  manner,  coordination  would  be  Improved  If  a 
briefing  facility  could  be  developed  which  would  present  Information 
concerning  the  scope  and  progress  of  the  various  projects.  This 
might  vise  visual  aids  generously  to  assist  those  interested  in  re¬ 
viewing  the  program  with  brief,  authoritative  summaries  showing  the 
projects  involved;  how  they  related  to  eeKsh  other;  the  goals  of  each; 
and  progress  to  date.  Copies  of  this  Information  could  be  made 
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available  periodically  to  all  partieipante  eo  that  they  could  beoeflt 
by  knowledge  of  the  *%ig  pictxire.” 

3he  nalBtenance  of  adequate  llalaon  with  the  military  la 
very  iiqportaot.  NeedleM  to  aay.  It  ia  bwrdeaaaae  to  the  eperatiag 
Navy  and  to  the  training  achoola  to  have  to  deal  directly  with  muay 
different  contractora.  Furthermore,  it  ia  quite  confuaing  to  them. 

It  ia  important  to  the  auceeaa  of  the  entespriae  that  we  all  draw 
upon  the  pooled  reaeureea  of  the  "team"  to  the  maximum  extent  while 
minimizing  "get  acquainted"  field  tripa  and  direct  requeata  to  the 
operating  activitiea.  Perhapa  periodic  briafinga  can  be  arranged 
where  the  military  can  cover  the  pointa  of  intereat  more  efficiently 
than  could  be  done  in  a  atring  of  aeparate  viaita.  Thia  ia  done 
routinely  in  the  ASV  field. 

Of  courae,  it  goea  without  aaylng,  that  a  central  aource  of 
information  could  serve  as  a  briefing  center.  IMs  could  include  the 
orientation  of  new  research  workers  who  are  undertaking  research  in 
AAW.  Similarly,  briefings  could  be  held  for  military  officers  entering 
billets  where  a  knowledge  of  the  training  research  program  is  essential. 
Feihapa  this,  too,  could  serve  to  limit  demanda  upon  military  operations 
and  training  persennol. 

There  are  some  of  the  coordination  functions  as  they  are  now 
perceived.  To  date  they  have  been  carried  out  by  QNR,  BuPers,  and  NTPC 
with  a  big  assist  from  Human  Sciences  Research.  However,  we  are  frankly 
fumbling  to  evolve  to  best  possible  means  for  aceoqplisbing  coordination 
within  existing  restraints.  The  present  reliance  upon  HSR  nay  prove  to 
be  a  stop  gap. 


A-80 


In  any  ease.  It  is  essential  to  en^haslze  that  effective 
coordination  can  not  he  imposed  upon  such  a  group  as  is  represented 
here.  Its  realization  depends  upon  a  helief  in  its  vsklue  and  a 
vllllngness  to  contribute. 
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Relevant  ORR  Research 


Olenn  L.  Bi^an 

John  Whlttenburg  and  Ed  Weiss  have  described  two  studies  that 
are  part  of  the  formal  structure  of  the  ASM  training  research  plan. 
Retiuning  to  the  analogy  I  used  earlier,  these  are  vertebrae,  the  planned 
research  In  direct  si^ort  of  AAW  operational  training.  We  now  turn  to 
the  ribs,  to  the  ongoing  and  planned  research  stiadles,  both  In-house  and 
within  the  contract  programs  of  research  supporting  organisations,  that 
have  relevance  for  AAW  training.  These  will  be  covered  In  overviews  of 
programs  by  representatives  of  research- sug^portlng  organisations  and  In 
more  detailed  reports  on  specific  research  projects  by  the  Investigators 
involved. 

I  will  report  briefly  on  some  of  the  studies  In  the  contract 
research  program  of  the  Psychological  Sciences  Division  of  the  Office  of 
Waved  Research  >rtilch  relate  to  AAW  training.  The  toteil  inrogram  consists 
of  some  200  contracts  and  gretnts,  primeurily  with  university  and  consnercled 
reseeurch  organizations  covering  a  fairly  broad  spectrum  of  research* 

The  general  eureas  of  psychology  covered  are  fairly  well  specified  by  the 
titles  of  the  four  branches  that  make  up  the  Psychological  Sciences 
Division:  Physiological  Psychology,  Groi^  Psychology,  Engineering  Psy¬ 
chology,  and  Persoiwel  and  Trcdnlng,  althouc^  the  latter  title  does  not 
suggest  the  substantial  program  of  basic  human  learning  research  that  is 
s\9ported. 

The  problem  of  deciding  irtiat  is  relevant  to  any  given  operational 
area  is  difficult  when  one  is  considering  a  basic  research  program. 
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Virtually  the  entire  program  can  be  thought  of  as  relevant  to  some  degree 
If  one's  frame  of  reference  is  simply  that  man  is  involved  in  the  system, 

I  have  chosen,  however,  to  restrict  my  selection  of  tasks  and  program 
areas  to  those  which  have  a  reasonably  direct  relationship  to  AAW  train¬ 
ing. 

The  work  that  Jdtm  >nilttenburg  has  ^ust  described  is  conducted 
under  ONR  contract  and  is,  of  course,  the  most  relevant  of  our  tasks, 
serving  as  it  does  as  a  provider  of  basic  information  for  the  training 
research  plan.  The  research  at  Princeton  under  John  Kennedy  and  Harry 
Schroder  which  we  will  hear  more  about  later  is  Jointly  supported  by 
the  Group  Psychology  and  the  Personnel  and  Training  Branches.  Bob  Glaser 
and  Dave  Klaus  will  discuss  the  program  of  their  Team  Training  Laboratory 
at  the  American  Institute  for  Research  in  Pittsburgh.  This  too  is  part 
of  the  ONR  program.  So  is  Joe  Rigney's  program  at  the  Eaectronics 
Personnel  Research  Group  at  the  Ifalversity  of  Southern  California.  The 
personnel  support  ship  concept  that  Joe  will  describe  today  represents 
the  development  of  a  idea  that  he  and  I  have  shared  for  some  time  but  it 
is  not  representative  of  Joe's  larger  program  at  USC.  The  general  mission 
of  his  project  is  to  conduct  research  in  areas  of  training,  selection, 
classification,  and  other  human  factors  problems  as  these  relate  to  the 
operatloned  employment  and  maintenance  of  electronic  equipment  by  personnel 
in  the  Fleets.  In  addition  to  earlier  directly  relevant  research  on  CIC 
personnel,  Joe's  more  recent  work  on  criterion  development  for  digital 
con^ter  personnel  cmd  maintenance  technicians  certainly  seems  to  have 
promise  for  applications  to  AAW  training. 

Bill  Vaughan  of  HSR  has  been  analyzing  the  tactical  decisions 
employed  by  submarine  commanders  under  an  ONR  contract.  He  is  atteiqptlng 
to  distinguish  the  several  kinds  of  data  processing  operations  that  are 
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performed  aad  the  criteria  enqployed.  UXtinately  he  hopes  to  provide  a 
basis  for  optimum  assignment  of  decision  tasks  to  men  and  equipment  in 
command- control  systems. 

We  also  support  a  number  of  basic  studies  of  the  human  problem 
solving  process.  Howard  Xendler  at  the  IMlversity  of  California  (Santa 
Barbara)  and  Donald  Taylor  at  Yale  are  examples.  Vfe  have  recently  in¬ 
itiated  a  contract  with  John  Suets  at  Bolt,  Beranek  and  Neuman  idilch 
might  have  some  pay-off  for  AAW.  It  involves  the  use  of  computer-based 
systems  to  teach  coaplex  concepts.  Da  this  sense,  however,  our  entire 
program  of  learning  and  training  resear^  has  at  least  some  relevance  for 
the  immediate  i»roblem  at  hand. 

The  small  group  research  supported  by  our  Group  Psychology  ftran^, 
particularly  those  studies  which  concern  themselves  with  group  conposltlnn 
are  relevant. 

Physiological  Psychology  and  Bngineerlng  Psychology  svpport  re¬ 
search  in  a  number  of  relevant  areas.  Their  work  on  cutaneous  and  voice 
communications,  on  visual  and  auditory  displays,  on  optimum  iUxmlnation 
levels,  and  on  vigilance  behavior,  to  mention  only  a  few,  have  Implications 
for  training. 

In  short,  it  has  been  my  purpose  to  give  you  a  sample  of  the  broad 
range  of  ONR- supported  research  wblidh  has  potential  a^lleabllity  to 
problems  of  operational  training*  More  specific  information  will  be  pre¬ 
sented,  by  our  contractors  on  the  program* 
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AAW  Training  Research  at  U.  S.  Naval  Training  Device  Center 

An  Overview 


James  J.  Regan 

Thank  you.  Dr.  Bryan.  I  never  cease  to  be  amazed  at  how  orderly  and  almost 
rational  this  plan  appears  to  be  in  the  telling,  when  in  fact  there  is  so  much 
anarchy  and  fortuitousness  associated  with  it.  This  is  not  to  suggest  that 
it  is  therefore  any  less  useful  as  a  heuristic  document.  On  the  contrary, 
we  hope  that  in  regarding  it  as  something  less  than  fully  determined,  you 
will  be  encouraged  to  contribute  to  its  continuing  formation. 

I' should  like  to  say  a  few  words,  if  I  may,  about  the  role  that  the  Training 
Device  Center  plans  to  play  in  this  effort.  In  the  course  of  doing  this, 
something  will  be  said  about  the  research  effort  at  the  Naval  Training  Device 
Center,  which  has  as  its  focus  the  training  environment.  We  worry  mostly 
about  training  equipment  and  systems  for  the  Navy,  the  Army,  and,  to  some 
extent,  other  agencies  of  Government.  It  is  not  always  easy,  in  terms  of 
this  training  equipment  mission  to  abstract  from  the  general  training  problem 
those  special  aspects  of  that  problem  which  bear  specifically  and  exclusively 
on  the  design  of  training  hardware.  1  should  like  therefore  to  suggest  that 
although  training  systems  and  hardware  represent  the  focus  of  our  research 
effort,  we  are  not  always  in  focus.  However,  I  believe  when  you  hear  the  re> 
ports  of  some  of  the  people  who  are  conducting  research  under  our  sponsorship 
you  will  recognize  the  central  question  which  we  always  ask  of  our  contractors 
and  ourselves,  "What  is  the  extent  and  character  of  the  required  simulation?" 

We  refer  here  to  that  simulation  required  to  enable  students  or  trainees  to 
develop  those  behaviors  which  they  must  exhibit  operationally.  1  should  like 
now  to  give  you  two  research  examples  of  an  historical  character  that  ask  im¬ 
portant  questions  about  simulation. 

One  has  to  do  with  the  problem  of  vehicular  control.  This  area  has  Interested 
psychologists  for  a  long  time  and  has  interested  the  Center  specifically  in 
connection  with  teaching  people  to  control  a  variety  of  vehicles  such  as 
submarines,  aircraft  and  tanks.  One  of  the  more  expensive  aspects  of  train¬ 
ing  equipments  designed  to  promote  vehicular  control  skills  is  the  computa¬ 
tional  feature  required  to  simulate  the  dynamics  of  some  given  vehicle.  These 
dynamics  are  what  intervene  between  the  output  of  the  student  and  the  response 
of  the  system  in  question.  Research  at  the  Electric  Boat  Company  some  years 
ago  showed  that  rather  significant  departures  from  the  operational  dynamics 
were  possible  without  any  serious  loss  to  the  trainee.  Such  departures  could 
take  the  form  of  reducing  or  eliminating  certain  cross-coupling  terms  and  other 
non-linearities.  The  measure  of  performance  in  this  instance,  as  with  un¬ 
fortunately  many  others,  was  the  inevitably  intermediate  criterion  —  in  this 
case  the  most  elaborate  simulation  of  vehiole  dynamics  at  that  time  available. 

A  related  problem  with  respect  to  the  extent  and  character  of  simulation 
occurs  when  one  asks  questions  about  the  specificity  of  training  equipment. 

This  question  arises,  for  example,  when  one  looks  at  tasks  related  to  radar 
scope  Interpretation  on  a  variety  of  radar  equipments.  One  of  the  consequences 
of  this  operational  equipment  variety  is  the  proliferation  of  specific  radar 
and  sonar  training  systems  designed  to  parallel  physically  the  operational 
equipments  in  the  field.  On  the  other  hand,  there  is  some  belief  that  much  of 
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the  variance  associated  with  skilled  operator  performance  on  these  equip¬ 
ments  is  not  specific  to  any  given  radar  set.  We  have  some  indication  that 
this  is  in  fact  the  case  and  there  is  some  researcn  n  our  program  directed 
at  specifying  the  circumstances  under  which  generalized  perceptual  training 
is  useful  and  how  much  of  what  one  must  ultimately  have  in  the  way  of  skill 
can  be  accounted  for  by  a  universal  or  generalized- type  trainer. 

Both  of  the  research  programs  to  which  I  have  alluded  and  in  fact  much  of  what 
has  already  been  said  this  morning  directly,  1  think,  relates  to  MW.  However, 
it  does  bring  up  a  question  about  which  I  should  like  to  talk  a  little  more 
fully  somewhat  later,  and  the  question  is  this,  "How  different  would  what  we 
have  said  this  morning,  and  are  likely  to  say  and  hear  for  the  balance  of 
these  two  days,  how  different  would  this  material  be  or  would  the  emphasis  be 
were  we  to  substitute  the  letters  ASW  for  MW,  or  for  that  matter  the  letters 
AEW  or  any  other  A's  of  which  you  may  be  aware?"  There  is,  1  believe,  a  fair 
amount  under  way  and  proposed  in  this  plan  which,  although  useful  to  MW 
training,  is  by  no  means  peculiar  to  it.  Therefore  another  of  the  questions 
1  think  we  ought  to  try  and  answer  is,  "How  worried  should  we  be  about  this, 
or  should  we  be  anything  but  worried  about  it?  Should  we  take  advantage  of 
the  characteristics  of  the  plan  which  allow  us  to  do  a  variety  of  things  which 
will  be  useful  at  the  same  time  to  MW  and  other  operating  training  situations?" 

Dr.  Bryan  mentioned  the  fact  that  this  plan  represented  a  sort  of  club;  and 
the  more  1  think  about  this  club,  the  more  it  seems  to  me  that  the  qualifications 
for  entering  are  not  restricted  to  any  particular  kind  of  training  research. 

I  in  fact  heard  Mr.  Friedman  say  that  we  were  not  confining  ourselves  to  train¬ 
ing  research.  However,  let  us  assume  for  the  moment  that  we  are  concerned 
primarily  with  training  research  and  the  implementation  of  research  findings 
already  in  existence.  I  guess  we  could  categorize  the  participation  of  the 
Center  and  its  contractors  in  three  categories  of  club  membership  related  to 
training  research.  One  is  direct,  the  second  is  indirect  but  specified,  and 
the  third  is  essentially  unspecified.  Let  me  now  describe  for  you  very  briefly 
a  few  examples  from  each  of  these  three  categories. 

The  first  one,  of  course,  is  the  Matrix  Corporation's  contract  about  which  you 
have  already  heard.  They  are  charged  with  the  development  of  a  plan  of  re¬ 
search  for  MW  and  with  laying  out  some  quick  fix  solutions  to  problems  that 
they  uncover  in  their  investigation  of  MW.  I  am  not  going  to  talk  further 
about  this  program,  for  the  reason  that  Dr.  Weiss  of  Matrix  Corporation  is  here 
specifically  for  that  purpose  and  also  because  being  here  he  is  in  a  position 
to  correct  any  mistakes  or  oversights  that  I  might  make  should  I  attempt  to 
do  so. 

The  second  project  especially  directed  to  MW  is  one  that  you  do  not  see 
on  theplan.  It's  the  third  bone  protruding  from  that  fish,  and  it  has  to  do 
with  systems  analysis i  It  represents  an  operations  analysis  approach  to  the 
problem  of  MW  training.  Specifically,  it  is  an  attempt  to  find  out  where  in  a 
complex  system  such  as  MW  one  might  most  profitably  apply  one's  limited 
training  resources  in  improving  operational  performance.  Said  another  way, 
this  would  involve  determining,  in  terms  of  time  or  dollars  or  some  other 
appropriate  measure,  which  improvements  in  one  or  more  of  a  variety  of  sub¬ 
systems  making  up  the  MW  system  would,  if  operated  on  from  a  point  of  view  of 
training,  have  the  most  substantial  effect  on  Che  overallsysCem  performance. 


The  second  of  our  three  categories  of  club  membership  has  to  do  with  a  part 
of  the  program  at  the  Center  which  is  referred  to  as  the  Applied  Research 
Program.  There  are  two  projects  in  this  category,  each  of  which  was  re> 
directed  slightly  to  make  its  products  somewhat  more  gern.ane  to  and  useful  for 
the  AAW  training  plan.  This  redirection  which  took  place  a  year  or  so  ago 
came  essentially  to  asking  the  researchers,  who  incidentally  are  both  here. 
Professor  George  Briggs  of  Ohio  State  University's  Laboratory  for  Aviation 
Psychology  and  Dr.  Raymond  Sidorsky,  Head  of  the  Human  Factors  Section  at 
The  Electric  Boat  Division  of  General  Dynamics,  to  learn  about  AAW  operations 
in  the  Navy.  Following  this,  they  are  in  their  laboratory  experimentation 
to  form  some  tasks  which  bear  relationship  to  tasks  performed  in  fleet  AAW 
operations.  This  request,  although  minor  on  the  surface,  is  of  some  im¬ 
portance,  I  think,  for  the  reason  that  in  all  of  the  research,  or  in  at  least 
much  of  the  research  which  we  sponsor,  it  is  becoming  increasingly  apparent 
that  a  factor  of  central  importance  in  deciding  on  which  of  a  number  of  al¬ 
ternate  ways  of  developing  some  specified  behavior  is  the  most  successful 
is  the  characteristic  of  the  task  abstracted  for  laboratory  manipulation. 

The  results  of  experimentation,  I  am  beginning  to  think  more  and  more,  are 
Importantly  related  to  the  characteristics  of  the  tasks  devised  for  laboratory 
experimentation.  Thus,  although  these  changes  may  appear  at  first  to  have 
little  effect  on  either  of  these  two  research  programs,  they  will  make  much 
more  meaningful  in  terms  of  AAW  application  those  results  that  will  be  forth¬ 
coming.  Again,  1  plan  not  to  present  any  detailed  description  of  the  work 
at  either  of  these  laboratories,  since  their  directors  are  here  and  plan  to 
do  precisely  that  today  and  tomorrow. 

The  third  and  roost  indirect  category  of  club  membership  is  represented  by 
much  of  the  balance  of  our  Applied  Research  Program  and  to  some  extent  our 
Psychological  Research  and  Development  Program.  I  plan  only  to  allude  to 
this  selected  sample  of  the  balance  of  these  programs,  and  1  hope  that  if  any 
of  these  items  prove  to  be  of  special  Interest  to  you  that  during  the  next 
two  days  we  will  have  some  opportunity  to  explore  them  in  greater  detail. 

The  first  has  to  do  with  something  called  adaptive  training.  This  idea  of 
adaptive  training  can  most  dramatically  be  expressed  by  describing  the  differ¬ 
ences  in  a  typical  learning  curve  that  would  result  between  the  normal  or  con¬ 
ventional  learning  situation  and  an  adaptive  one.  Ordinarily,  one  would  ex¬ 
pect  to  see  a  learning  curve  changing  ever  time  from  some  relatively  low  per¬ 
centage  of  success  to  something  approaching  100%,  let's  say.  In  an  adaptive 
system  one  would  have  a  learning  curve  with  an  essentially  zero  slope.  The 
characteristics  of  the  training  system  or  training  equipment  would  be  changing 
with  the  changing  skill  of  the  student. I  The  students'  performance  would  be 
more  or  less  fixed  at  some  as  yet  undetermined  level  of  success,  say  between 
40  and  60%.  A  measure  of  how  well  the  stuilent  did  would  be  the  state  of  com¬ 
plexity  of  the  training  system  at  the  end  kt  training.  We  have  some  research 
under  contract  and  the  beginnings  of  some  Wrk  in  this  area  in-house. 

A  second  item  which  bears  directly  on  the  design  of  training  equipment  which 
is  of  some  interest  to  os  has  to  do  with  feedback.  By  feedback  1  refer  here 
to  supplemental,  augmented,  action,  and  learning;  in  general  any  information 
to  the  trainee  about  i^t  he  has  or  has  not  done.  Feedback  may  be  compared 
with  cuing;  defined  as  information  presented  before  or  during  the  stimulus 
presentation.  For  example,  if  one  were  presenting  i  scope  picture  with  a 


B-7 


lot  of  noise  In  which  was  Imbedded  a  target  and  we  wished  to  have  the  student 
learn  to  Identify  this  target,  one  might  encircle  the  target  electronically  >- 
put  a  hook  around  It  —  and  thus  provide  an  Important  cue  to  the  student  In 
his  attempts  to  localize  the  target.  Feedback  In  the  same  situation  would 
result  from  telling  the  student  after  he  had  attempted  to  Identify  the  target 
whether,  In  fact,  he  had  done  so  correctly.  We  have  some  work  now  which  Is 
nearing  completion  at  the  Universities  of  Sheffield  and  Aberdeen  In  England 
which  Is  concerned  with  the  relative  merits  of  feedback  and  cuing.  There 
are  two  interesting  points  that  we  are  finding  or  tending  to  find  In  this  pro¬ 
ject  and  In  some  work  performed  by  Dr.  Swets  of  Bolt,  Beranek  and  Newman. 

Cuing  In  many  situations  tends  to  be  more  beneficial  than  feedback.  A  second 
point  of  Interest,  particularly  from  the  point  of  view  of  training  equipment, 
is  that  the  characteristics  of  cuing  are  going  to  vary  as  a  function  of  the 
kind  of  task  involved.  For  example,  if  one  were  learning  to  Identify  a  tone 
in  noise  in  an  auditory  situation,  an  appropriate  technique  for  cuing  would  be 
to  bring  the  level  of  the  signal  beyond  that  of  the  noise  or  conversely  to 
reduce  the  noise  thus  changing  the  signal- to-nolse  ratio,  thus  making  the 
problem  of  Identifying  the  sound  a  much  simpler  one.  On  the  other  hand.  If 
one  were  faced  with  an  analogous  visual  problem  of  Identifying  a  target  on 
a  noisy  scope,  rather  than  reduce  the  noise  or  brighten  the  target,  thus 
changing  the  signal- to-noise  ratio,  a  more  appropriate  cuing  technique  would 
be  to  present  the  target  picture  as  It  would  appear  ultimately  and  to  encircle 
or  In  some  way  point  out  to  the  student  where  the  target  Is.  We  are  just  be¬ 
ginning  to  get  some  feel  for  the  variations  possible  In  this  form  of  cuing  and, 
for  that  matter,  some  of  the  more  specific  features  of  feedback. 

These  then  constitute  some  examples  of  each  of  the  three  categories  of  NTDC 
membership.  In  fact.  It  constitutes  all  of  the  projects  In  Category  One  and 
Two,  and  selected  samples  of  Category  Three. 

I  should,  by  way  of  conclusion,  like  to  raise  several  questions  that  came  to 
my  mind  as  I  sat  here  this  morning.  One,  I  have  already  brought  up  In  asking 
the  question  about  AA  versus  AS  and  AEW.  A  second  relates  to  the  difficulties 
In  making  or  reaching  decisions  either  In  the  formation  of  a  training  plan,  or 
for  that  matter  In  a  systems  analysis  which  derive  from  a  lack  of  quantitative 
Information  concerning  the  output  characteristics  of  the  system  with  which  we 
are  concerned.  Suppose  one  were  able  to  say  that  the  AAW  system  must  In  some 
given  time  and  under  some  specified  environmental  situation  destroy  X  targets 
In  Y  time  and  that.  In  fact,  we  were  shooting  down  X  minus  some  value  (targets) 

In  Y  plus  some  value  of  time.  And  further,  if  one  were  to  make  certain  changes  In 
the  training  program, one  could  effect  certain  changes  in  these  criteria,  then 
we  would  have  a  rather  specific  handle  with  which  to  approach  the  problem. 

This  then  becomes  a  manlpulable  bit  of  Information  which  1  am  not  too  sure 
we  have  right  now.  I  am  not  even  suggesting  that  we  can't  proceed  until  we 
have  this  kind  of  information  fully  in  hand  or  for  that  matter  do  I  believe 
that  there. Is  a  great  likelihood  that  it  will  ever  be  available  in  quite  the 
form  .I've  described  it.  It  does,  nonetheless,  seem  important  to  develop  some 
estimates  in  quantitative  terms  for  use  In  allowing  us  to  arrive  at  common 
decisions  with  respect  to  what  In  the  system  from  a  training  point  of  view  ought 
to  be  attacked. 


There  are  several  research  Issues  which  might  be  reflected  In  the  plan.  The 
first  has  to  do  with  the  extent  to  which  the  characteristics  of  the  task  or 
task  specificity  influence  the  methods  or  techniques  which  we  might  suggest 
as  being  optimum  in  some  given  training  situation. 

The  second  is  the  general  area  of  computerized  learning  systems.  I'm  sure  you've 
all  heard  a  great  deal  about  this  area  and  probably  most  of  you  are  a  good  deal 
more  familiar  with  its  problems  and  potential  than  1  am.  It  would  seem  that 
the  presence  of  computers  in  operational  systems  is  at  once  creating  new  and 
difficult  human  performance  situations  for  which  adequate  training  solutions 
have  yet  to  be  determined  and  at  the  same  time  opening  up  opportunities  for 
rendering  much  more  efficient,  a  wide  variety  of  training  environments,  many 
of  which  haven't  changed  in  centuries.  In  connection  with  computer-based  in¬ 
structions,  work  that  we  have  sponsored  at  Bolt, Beranek  and  Hewman  as  well  as 
some  of  the  work  in  the  teaching  machine  or  automated  instructional  area  is 
providing  us  with  some  new  Insights  about  widely  held  principles  of  learning. 

Such  practices  as  constructed  response  and  small  step,  errorless  learning,  for 
example,  frequently,  or  at  least  under  specified  circumstances,  do  not  pro¬ 
mote  optimally  the  acquisition  or  transfer  of  material.  Particularly  in 
the  case  of  associative  learning,  it  appears  that  a  straightforward  sort  of 
''brute  force"  learning  situation  is  at  least  as  effective  as  some  of  the  more 
elaborately  organized  learning  environments. 

There  is  also  a  matter  of  individual  differences.  Psychologists  have  long 
recognized  that  individuals  do  in  fact  differ  in  a  variety  of  ways.  On  the 
other  hand,  at  the  end  of  some  period  of  training  we  expect  a  group  of  personnel 
to  emerge  with  common  skills.  It  also  seems  that  in  general  there  is  some  one 
standardized  way  of  attempting  to  develop  this  common  level  of  proficiency. 

One  of  the  questions  we  then  might  ask  ourselves  is  whether  or  not  we  might 
bring  a  group  of  individua7s  more  quickly  and  efficiently  to  some  specified 
common  level  of  proficiency  by  providing  non-standardized  techniques  for  getting 
there.  That  is  to  say,  we  might  recognize  the  individual  differences  and  alter 
the  structure  of  the  course  or  more  specifically  the  method  of  presenting  the 
information  as  a  function  of  one  or  more  identified  dimensions  of  differences. 

One  point  about  AAW  training  equipment  Dr.  Bryan  quite  correctly  pointed  out 
this  morning  —  that  there  has  been,  are  now,  and  probably  will  continue  to  be 
a  number  of  rather  expensive  and  elaborate  training  systems.  Examples  of 
this  elaborate  equipment  include  the  training  facility  at  Dam  Meek,  its 
sister  facility  at  Point  Loma,  Callfori^ia,  the  tactical  facility  at  Norfolk, 
and  the  upcoming  air  defense  trainer  ac  Glynco,  Georgia.  It  is  a  character¬ 
istic  of  chase  and  many  other  group  tactical  trainers  that  they  are  essen¬ 
tially  unstructured.  It  seems  therefore  that  we  should,  in  addition  to  being 
concerned  about  the  specific  characteristics  of  the  equipments  (i.e.  the 
displays  to  the  students,  techniques  for  f^dback  to  the  students  and  instruc¬ 
tor  control  of  the  training),  also  be  concerned  with  techniques  for  employ¬ 
ment..  This  is  especially  true  precisely  because  these  large  training  facili¬ 
ties  are  so  unstructured  educationally.  I  believe  Che  opportunities  to  im¬ 
prove  these  training  systems  already  in  existence  lie  more  in  Che  direction 
of  improved  employment  than  in  the  d'  ction  of  re-design.  I  think  efforts 
toward  design  probably  should  be  dit  ted  toward  entirely  new  training  equip¬ 
ment  complexes.  The  Fleet,  far  from  being  unwilling  to  accept  assistance 


from  people  such  as  ourselves  is.  In  my  experience,  quite  anxious  to  accept 
such  employment  materials  as  problem  scripts  and  to  avoid  providing  this 
assistance  on  the  grounds  that  Fleet  personnel  wish  themselves  to  decide 
how  to  train  is  the  height  of  rationalisation. 

1  am  not  at  all  certain  that  this  kind  of  activity  is  quite  properly  described 
as  training  research  and  perhaps  it  is  not.  In  any  event,  it  brings  me  to 
the  last  of  the  several  points  I  wish  to  make.  Although  the  label  of  this 
effort  is  the  development  of  a  training  research  plan  and  the  conduct  of  train¬ 
ing  research,  there  is,  I  suspect,  a  fair  amount  of  activity  which  can  take 
place  under  the  general  aegis  of  this  effort  which  is  not  properly  training 
research  at  all.  For  example,  the  application  of  existing  information  de¬ 
rived  from  research  in  human  learning  and  training  and  to  situations  in  Fleet 
training  and  elsewhere  would  seem  to  be  a  useful  contribution. 

Now  that  was  the  first  final  point.  There  are  one  or  two  final,  final  points 
I  should  like  to  make  concerning  the  features  of  this  plan  which  are  parti¬ 
cularly  appealing  to  me.  One  is  that  it  isn’t  really  as  organised  as  it 
would  appear  to  be  in  the  telling.  This  truth,  in  fact,  enhances  the  inter¬ 
est  of  the  plan  for  me.  The  second  and  perhaps  more  important  feature  is 
that  the  plan  has  engendered  a  considerable  amount  of  Interest  at  almost 
every  level  of  the  Navy.  All  of  the  years  that  I  have  been  involved  in 
working  in  Naval  Research  I  have  frequently  been  in  the  position  of  having 
to  go  hat  in  hand  into  Navy  field  activities  requesting  some  limited  amount 
of  time  and  some  limited  form  of  cooperation  in  one  of  our  research  endeavors. 
Since  the  Chief  of  Naval  Operations  is  supporting  this  plan  in  principle  and 
in  certain  of  its  specifics,  when  in  the  future  one  or  more  of  you  or  some 
other  researcher  attempts  to  obtain  some  information  at  a  Naval  operating 
activity,  he  is  more  likely  to  be  able  to  obtain  it  and  they  are  more  likely 
to  be  able  to  provide  the  time  and  facilities  necessary.  At  the  same  time, 
this  places  a  responsibility  on  us  for  the  coordination  of  an  effort  as 
large  as  this.  Otherwise,  irrespective  of  the  level  of  support,  the  2S0th 
contractor  who  makes  his  way  into  Dam  Neck,  Virginia,  is  going  to  be  in 
some  difficulty. 

Another  feature  of  the  plan  which  is  appealing  is  that  it  can  serve  to  bring  some¬ 
what  closer  together  two  words  —  R  and  D  —  idiich  appear  in  print  separated 
only  by  the  word  "and",  but  which  in  reality  are  sometimes  worlds  apart.  Not 
only  does  the  plan  provide  for  using  existing  data  but  that  research  which 
is  engendered  by  the  plan  itself  will,  within  the  plan,  have  an  opportunity 
for  implementation.  In  fact  provisions  are  made  for  employing  in  a  trial  fashion 
in  operating  units  the  results  of  the  research  effort. 

That  pretty  well  concludes  idtat  I  have  to  say.  Are  there  any  questions? 
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Relevant  BuPers  Research 
Sidney  Friedman 

I  should  first  like  to  indicate,  by  way  of  introduction,  that 
we  of  the  Bureau  of  Naval  Personnel,  Research  Division,  are  grateful 
for  the  opportunity  to  meet  with  all  of  you  to  discuss  mutual  problems 
in  the  important  area  of  Anti -Air  Warfare  Research.  I  am  sure  1  speak 
for  each  o£  my  colleagues  and  co-workers,  Drs.  Earl  Jones  and  Ed  Rund- 
quist  of  our  Training  Research  Laboratory  in  San  Diego,  and  Mr.  A1 
Sjoholm  who,  like  myself,  is  located  at  Research  Division  headquarters 
here  in  Washington. 

Second,  I  should  like  to  tell  you  that  I  was  a  very  small  part 
of  a  very  determined  effort  begun  over  a  year  and  a  half  ago,  largely 
as  a  result  of  the  untiring  efforts  of  Glenn  Bryan,  which  was  designed 
to  come  up  with  a  part  of  an  ideal  program  package  of  research  in  AAW. 

As  part  of  this  effort,  I  accompanied  Glenn  Bryan  and  others  on  at 
least  two  trips  to  Dam  Neck,  to  hear  about  and  discuss  problem  areas 
in  AAW  operations  and  to  think  about  ways  in  which  they  might  be  solved. 

I  was  overwhelmed  by  the  magnitude  of  the  problems  as  presented;  but  was 
encouraged  by  the  attitudes  and  opinions  expressed  with  regard  to  the  re¬ 
cognition  of  the  importance  of  a  well-designed  systematically  developed 
research  program  as  a  probable  only  mean$'  for  solving  these  problems. 

I  must  also  admit,  however,  that  my  input  to  the  thinking  and  actual 
planning  effort  expended  to  achieve  at  least  the  draft  of  such  a  program 
was  extremely  small  by  comparison  with  Dr.  Bryan's  and  Dr.  Regan's  efforts. 
Nevertheless,  we  still  see  ourselves  as  being  vitally  concerned  with  this 
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program.  So  I  will  try  to  tell  you  a  little  bit  about  things  we  u-ive 
done  in  the  past,  what  we  are  now  doing,  and  what  we  plan  to  do,  inso¬ 
far  as  these  things  have  relevance  to  the  overall  AAW  Research  Program 
as  described  by  Dr.  Bryan. 

Our  interest  and  efforts  in  this  general  area  go  back  many  years  — 
long  before  people  spoke  of  an  AAW  Personnel  and  Training  Research 
Program.  For  example,  about  12  years  ago  we  attempted  to  validate  some 
of  our  experimental  officer  calssification  tests  against  success  in  CIC 
training,  and  appeared  to  meet  with  some  success,  by  way  of  some  modest 
validities  against  school  criteria.  This  effort,  however,  was  doomed 
by  the  administrative  consideration  that  all  line  officers  were  expected 
to  succeed  In  this  kind  of  training,  and  that  If  they  didn't,  training 
would  have  to  be  modified  so  that  all  would  pass.  Also,  as  our  modest 
friend  Glenn  Bryan  will  recall,  in  1953,  (I  think)  we  asked  the  BPO  at 
Southern  California,  under  contract  with  OHR,  to  conduct  research  on  CIC 
officer  requirements  and  standards  aboard  ship.  A  report  on  this  effort 
was  published  In  1954  by  Dr.  Bryan. 

We  have,  also  in  the  distant  past,  supported  the  conduct  of  research 
on  contract  with  ETS,  designed  to  obtain  a  better  understanding  of  what 
one  of  our  officer  tests,  namely  Relative  Movement,  which  was  peculiarly 
designed  to  be  predictive  of  the  kinds  of  things  CIC  officers  are  supposed 
to  do,  was  actually  measuring. 

In  addition,  we  have  from  time  to  time  concerned  ourselves  with 
piecemeal  problems  related  to  selection  and  training  of  various  enlisted 
ratings.  We  feel  that  the  findings  of  some  of  our  studies  might  be 
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germaine  to  our  problem  at  hand  Insofar,  at  least,  as  they  ml^t  reveal 
profitable  or  non- profitable  approaches  as  we  attempt  to  put  all  the 
bits  and  pieces  together  in  our  effort  to  obtain  some  sort  of  meaningful 
whole. 

More  recently,  and  particularly  over  the  past  3  to  4  years,  the 
Bupers  program  has  devoted  a  sizable  effort  to  personnel  research 
associated  with  new  hardware  developments.  As  one  might  suspect,  much 
of  this  work  has  been,  and  still  is,  connected  with  Surface  to  Air 
Missiles  and  Missile  Systems,  as  well  as  on  the  Naval  Tactical  Data 
System  —  Essentially  work  along  these  lines  may  be  divided  into  4  broad 
categories  -  first,  that  which  is  concerned  with  the  predictive  aspects 
of  personnel  and  training  requirements;  second,  work  concerned  with  the 
development  of  proficiency  tests  on  specific  weapons  and  weapons  systems 
or  subsystems;  third,  work  concerned  with  development  of  administratively 
usable  and  useful  training  feedback  procedures;  and  fourth,  work  connected 
with  the  evaluative  aspects  of  testing  the  personnel  subsystem  as  part  of 
the  overall  OPTEVFOR  evaluation  procedures. 

More  specifically,  I  might  mention  that  efforts,  particularly  in 
the  first  two  categories  has  either  been  completed  or  is  well  underway 
on  such  systems  as  Tarter,  Talos,  Terrier,  Typhon  as  well  as  the  AM/^PS-48 
and  49  Radars. 

I  have  a  little  more  detail  covering  the  type  of  research  covered  in 
connection  with  the  Tarter  system,  if  such  details  are  desired  at  this 
time.  Otherwise,  I  shall  merely  indicate  that  an  annotated  bibliography 
covering  most  of  the  work  referred  to  can  be  made  available  on  request. 
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Detailed  reports  themselves  are  generally  classified  and  might  be 
available  consistent  with  governing  security  procedures.  If  you  do 
have  any  other  specific  questions  concerning  the  New  Developments 
Research  Program,  I'm  sure  that  A1  Sjoholm,  who  heads  the  program  in 
BuPers,  will  do  his  best  to  answer  them. 

Which  brings  us  to  now  —  But  going  back  a  bit  to  the  general  plan 
described  by  Glenn  Bryan,  you  will  recall  that  I  indicated  that  I  did 
try  to  contribute  some  small  somethings  to  the  thinking  which  went  into 
the  plan.  These  small  somethings  took  into  account  the  plans  we  had 
to  expand  our  overall  training  research  effort,  which  I’m  most  happy 
to  report,  we  are  now  well  on  our  way  toward  accomplishing  (I  will 
leave  it  to  Drs.  Jones  and  Rundquist  to  fill  you  in  on  some  of  the 
details  and  to  answer  any  questions  you  might  have,  after  they  have 
made  their  presentations.)  In  any  event,  we  felt  that  dependent  on  the 
phasing  and  outcomes  of  tasks  01,  11,  12  and  perhaps  13  -  we  should  be 
ready,  with  our  expanded  training  research  effort,  to  undertake  work 
on  Tact  20.  As  a  matter  of  fact  I  believe  that  Dr.  Rundquist 's  pre¬ 
sentation  will  reveal  that  we  may  have  already  begun  to  do  so.  And, 
so  I'll  let  that  one  rest. 

With  respect  to  item  22  I  feel  that  whereas  I  agreed  in  principle 
with  the  need  for  such  kind  of  research  I  am  at  present  not  quire  sure 
as  to  the  direction  or  order  of  magnitude  of  effort  which  we  in  BuPers 
might  be  prepared  to  undertake  in  this  area. 

On  this  note  of  uncertainty,  I  should  like  to  again  express  my 
gratitude  for  having  this  opportunity  to  speak  with  all  of  you  in  this 
informal,  relaxed  atmosphere,  thanks  to  our  chairman  and  our  hosts. 
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General  Comments  Concjerning  the  Work  of  the 
Navy  Training  Research  Laboratory  and  the  Research  in  the  AAW  Area 


Earl  I.  Jones 

Bureau  of  Naval  Personnel 

Having  been  given  the  opportunity  to  address  this  group,  there  are  four 
kinds  of  remarks  I  wish  to  make. 

First,  I  wish  to  thank  all  those  responsible  for  planning  this  conference 
for  inviting  Dr,  Rundquist  and  me  and  for  their  excellent  hospitality. 

Secondly,  I  want  to  touch  briefly  upon  the  first  three  sub-objectives  of 
the  conference  as  outlined  in  Attachment  1.  With  respect  to  sub-objective  "a," 

I  think  the  major  problems  are  communications,  acceptance  of  a  common  goal, 
delineation  of  responsibility,  acceptance  by  the  military,  and  the  sheer,  hard 
work  by  someone  to  see  to  it  that  coordination  occurs.  My  personal  impression 
is  that  Glenn  Bryan  and  others  have  accomplished  a  major  step  toward  coordi¬ 
nation  in  establishing  this  conference  and  doing  the  great  amount  of  spade  work 
which  was  required  to  get  this  group  together.  With  respect  to  sub-objective 
"b,”  it  appears  to  me  that  our  old  friend,  the  criterion  problem  has  again 
reared  its  ugly  head  and  can  be  succinctly  described  as  a  critical  methodological 
problem.  With  respect  to  sub-objective  "c”  my  only  conmient  is  that  as  a  result 
of  this  conference  I  have  been  learning  what  some  of  the  major  problems  are 
perceived  to  be. 

My  third  set  of  remarks  concerns  the  program  of  the  Navy  Training  Research 
Uboratory  and  its  as  yet  brief  encounter  with  the  AAW  area.  In  regard  to  this 
set  of  remarks  I  wish  to  correct  an  impression  which  may  have  arisen  because 
of  some  remarks  made  yesterday  by  Mr.  Friedman.  In  reference  to  Task  .20  of 
the  plan  presented  by  Dr,  Bryan,  te.  Friedman  suggested  that  the  Navy  Training 
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Research  Laboratory  was  already  working  on  Task  .20.  This  is  not  entirely  true. 
It  is  entirely  and  unintentionally  untrue  and  resulted  from  the  fact  that  one 
of  our  tasks  has  a  title  which  bears  some  reseiid>lance  to  the  title  of  Task  .20. 

Let  me  briefly  outline  the  Navy  Training  Research  Laboratory's  current 
program.  We  have  underway  or  in  planning  training  research  projects  in  ASW, 
Electronics,  Aviation  Technical  Training,  Shipboard  Training  and  AAW.  Exc^t 
for  a  couple  of  crash  projects  over  the  years  we  are  newcomers  to  the  AAW  area. 
However,  some  of  our  previous  work  in  the  areas  of  ASW  and  Electronics  does, 

I  think,  have  implications  for  AAW.  Several  of  our  early  ASW  studies  by  Angell 
and  Kuhn  were  directed  at  the  team  criterion  problem.  We  were  able  to  construct 
standard  runs  (attack  problems  in  which  the  maneuvers  and  speeds  of  the  sub¬ 
marines  were  controlled)  which  represented  stable  mean  levels  of  difficulty. 
Criterion  measures  employed  were  location  error  (the  error  in  yards  from  ord¬ 
nance  explosion  point  to  submarine  center  at  tiiw  of  fire  center  on  the  recorder 
trace) ,  a  total  run  score  obtained  from  center  bearing,  collision  course, 
attack  lead,  pattern  location  error,  and  kill— each  scored  on  a  five  point 
scale,  and  kill  (hit  or  miss)  by  itself.  As  would  be  expected,  these  measures 
correlated  highly  (.80)  with  each  other.  The  measures  discriminated  reliably 
between  runs  (i.e.,  problem  difficulty),  but  no  reliable  discrimination  could 
be  made  between  team  performances  for  the  20  teams  used  in  the  study. 

Angell,  in  another  study,  constructed  a  check  list  of  A/S  officer  per¬ 
formance  in  single  ship  attacks  whose  test-retest  reliability  correlation  was 
.75  for  an  A/S  officer  student  group  and  .55  for  a  Deck  Officer  student  group. 
The  test-retest  reliability  correlation  of  the  total  attack  error  scores  on 
the  A/S  officer  group  was  .48.  The  correlation  between  check  list  total  scores 
and  total  attack  error  scores  for  the  Deck  Officer  group  was  not  si^ificantly 
different  from  tero.  For  the  A/S  officer  group  the  correlation  between  check 
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list  total  scores  and  total  attack  error  scores  on  the  retest  was  .34.  This 
is  significantly  different  from  zero  at  the  5  per  cent  level  of  confidence. 

It  can  be  seen  that  both  a  check  list  of  officer  performance  and  attack  error 
are  sufficiently  reliable  to  suggest  further  use,  especially  for  research 
purposes. 

To  summarize  these  studies  then,  it  amP**!*^  bhat  by  using  standard  runs 
of  known  difficulty,  attack  error  mi^t  furnish  some  measure  of  team  performance 
if  further  refined.  Conning  officer  performance  contributed  a  significant 
portion  of  the  variance  in  team  performance.  With  perfected  attack  error 
scoring  techniques  and  with  teams  of  greater  training  and  e]q>erience  differ- 
pnces,  teams  might  be  ordered  on  a  continuum  of  proficiency  in  terms  of 
location  error  scores. 

Roemmich  carried  out  another  set  of  studies  in  our  early  efforts  in  ASW 
team  training  research.  This  set  concerned  an  evaluation  of  the  then  current 
status  of  ASM  team  training.  One  peripheral  finding  from  this  work  which 
might  be  of  interest  here  concerned  team  members  perceptions  of  the  charac¬ 
teristics  of  "good  and  "poor"  ASW  teams.  Since  "poor"  characteristics  were, 
for  the  most  part,  simply  the  opposites  of  "good"  characteristics  only  those 
"good"  characteristics  frequently  indicated  by  team  meiid>ers  will  be  listed 
here.  They  are: 

1.  Proper  application  of  procedures,  doctrine,  terminology 
(Smoothness,  frequency  and  accuracy  of  information). 

2.  Good  supervision,  leadership,  and  good  discipline.  Leaders 
have  control  of  team  at  all  times. 
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3.  Teamwork  and  coordination  betwee**  t'am  members,  e.g.,  under* 
standing  the  use  and  purpose  of  reports,  and  working  together  and  anticipating 
actions  and  needs  of  others. 

4.  Individual  competence  on  own  job  and  jobs  assigned  when  rotated, 
e.g..  Conn  knows  tactics,  stack  can  hold  contact,  A/P  relays  and  checks  in¬ 
formation,  and  everyone  follows  doctrine. 

5.  Good  attitude  and  interest  on  part  of  men. 

6.  Confidence  of  men  in  Officers  and  officers  in  men.  Also  mutual 
respect  among  officers  and  men. 

7.  Complete  cooperation  between  Bridge,  CIC,  and  sonar. 

1  would  like  to  shift  now  to  a  different  aspect  of  NTRL's  work.  A  commonly 
recognized  fact  in  the  Navy' is  that  maximum  operatior  or  equipment  proficiency 
is  limited  by  the  condition  (alignment,  calibration,  etc.)  of  equipment.  Conse¬ 
quently,  ability  in  electronics  maintenance  is  vital  for  fleet  readiness  in 
ASW,  AAW,  or  any  modern  warfare  area.  For  several  years  our  training  research 
efforts  have  included  a  large  proportion  of  work  concerned  with  problems  in  the 
training  of  electronics  personnel.  From  several  objective  surveys  of  the  per¬ 
formance  of  Navy  technicians  it  became  obvious  that  in  a  number  of  ratings  the 
"average"  ability  of  technicians  to  carry  out  required  maintenance  was  below 
the  level  needed  for  adequate  maintenance.  To  date,  we  have  worked  on  problems 
related  to  the  training  of  ET's,  AT's,  SO's,  AE*s  and  AM's.  We  are  currently 
doing  evaluative  studies  of  the  training  and  performance  of  MT's,  OS's  and  FT's. 
These  latter  three  ratings  have  responsibilities  related  to  AAIY  readiness. 
Because  of  the  Navy's  rating  structure  and  system  of  distribution  and  assign¬ 
ment  of  personnel,  one  of  the  continuing  and  vexing  problems  concerns  training 
which  is  highly  and  specifically  oriented  toward  one  or  more  specific  pieces 
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of  equipment.  ET's,  for  exaa^le,  are  responsible  as  a  groiqp  for  the  mainte¬ 
nance  of  more  than  240  different  equipments.  Since  formal  training  on  the 
maintenance  of  all  of  these  equipments  cannot  possibly  be  provided,  the 
planning  of  training  which  can  yield  maximum  transfer  and  generalization  is 
a  major  problem.  Much  of  our  current  effort  and  future  plans  in  Electronics 
training  deals  with  this  problem,  I  will  not  go  into  further  detail  here, 
but  I  hope  that  1  have  made  the  point  that  there  is  a  considerable  amount  of 
research  not  aimed  directly  at  the  AMI  problem  which  does,  nevertheless, 
have  important  implications  for  AAW  readiness. 

As  for  research  directly  concerned  with  AAW,  the  main  reason  we  have  done 
so  little  in  the  AAW  area  in  the  past  is  the  result  of  polite,  cold  resistance 
on  the  part  of  those  responsible  for  AAW  to  our  research  overtures  in  past 
years.  The  reason  we  are  now  working  in  and  developing  plans  for  further 
work  in  AAW  is  the  result  of  three  main  influences:  (1)  the  good  fortune  to 
have  established  rapport  with  the  Commanding  Officer,  FAAWTC,  San  Diego, 

(2)  the  good  fortune  of  having  been  invited  by  Glenn  Bryan  to  participate  in 
this  area,  and  (3)  the  good  fortune  to  have  had  a  man  recently  join  our  staff 
after  spending  several  years  with  SDC,  Santa  Monica.  This  leads  me  to  the 
fourth  and  last  set  of  remarks  I  wish  to  make.  I  would  like  to  introduce 
Dr.  Edward  Rundquist,  our  man  from  SOC,  who  will  describe  for  you  the  modest 
beginnings  of  our  program  in  AAW  training  research. 


B-i9 


Current  NTRL  Work  in  the  AAW  Area 


Edward  A.  Rundquist 
Bureau  of  Naval  Personnel 

It  would  be  difficult  to  spend  a  nuinber  of  years  at  SDC  and 
not  develop  an  interest  in  team  training  —  in  such  problems  as 
Influence  of  individual  task  allocation,  group  structure  and  group 
compatablllty  on  group  performance.  In  pursuing  this  Interest  in 
new  (Havy)  surroundings,  however,  one  must  first  become  acquainted 
with  the  setting  before  determining  how  this  research  interest  can 
best  serve  Navy  purposes.  With  respect  to  AAN  we,  like  the  Qetman 
philosophers,  are  beginning  doubtfully  and  far  away. 

As  part  of  my  own  education  in  Navy  characteristics  and 
problems  I  took  the  CIC  Watch  Officers  Covurse  offered  by  FAAWTC, 

San  Diego.  This  ejqjerience  roiised  my  interest  in  the  problem  of 
determining  course  content  under  conditions  of  severe  time  con¬ 
straints  relative  to  the  material  to  be  covered  —  ABW,  Surface  Oper¬ 
ations,  Amphibious  Operations,  and  Anti-Air  Warfare  Operations  — 
to  mention  only  the  major  areas.  We  have  eiid>arked  on  a  coopera¬ 
tive  venture  with  the  instructors  of  this  course  to  redesign  it  — 
a  venture  in  curriculum  engineering.  It  Is  hoped  that  tiltlmately 
a  technology  can  be  devised  for  instructors  to  follow  in  desl^iing 
and  redesiffiing  a  course.  Sven  in  the 'early  phases  of  the  work 
we  have  run  Into  many  of  the  problaos  already  mentioned  at  this 
confeience  ~  particularly  the  problem  of  definition  of  terminal 
behavior  the  course  should  s4m  at  achieving.  There  is  so  much 
variation  in  the  way  ultimate  performance  is  achieved  on  shipboard 
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that  we  are  finding  It  rou^  going  to  specify  course  objectives 
precisely  and  in  terms  which  will  permit  asking  meanlngf\il 
questions  about  each  to  permit  evaluation  of  the  criticality,  level 
of  skill  required,  and  so  on,  in  order  to  aid  in  the  rational 
selection  of  course  content. 

even  less  related  to  the  AAW  problem  is  a  study  of  methods 
of  maneuvering  board  instruction.  As  you  probift>ly  eiU  know,  the 
maneuvering  board  is  an  aid  for  the  graphic  solution  of  problems 
of  relative  motion  --  such  problems  as  intercepting  another  ship 
or  determining  course  and  speed  to  arrive  at  a  specific  position 
in  a  changing  formation. 

A  substantial  part  of  the  CIC  Watch  Officers  Course  that  1 
attended  tias  devoted  to  nsneuvering  board  instruction,  despite 
the  fact  that  students  were  siipposed  to  arrive  at  the  course  with 
this  skill.  She  inmedi^tte  pimetical  problem  being  investigated  is 
whether  there  are  differences  in  the  ease  of  solving  the  problems 
using  own  ship  in  center,  other  ship  in  center,  or  either  ship  in 
center  —  three  methods  which  are  in  current  use  and  about  the 

+v.o..«  ■(«  (Hlnnirhe. 

We  have  a  longer  range  interest  ->  the  investigation  of  the 
role  of  conceptual  models  in  learning  and  retention.  Dr. 
WlUtteiiburg  has  presented  us  with  an  admirable  series  of  con¬ 
ceptual,  models  in  his  presentation.  Bvery  instructor  uses 
diagramatio  models  like  these  in  his  teaching.  I  have  a  suspicion, 
however,  that  these  models  are  n  fully  exploited  in  instruction. 


B-22 


Further,  these  models  may  veil  differ  in  effectiveness  for  different 
ability  levels.  In  terms  of  this  long  range  interest,  the  maneuver¬ 
ing  board  vlll  serve  as  a  vehicle  for  studying  different  conceptual 
models.  From  this  point  of  view  present  studies  are  serving  to 
provide  infonnatioa  about  the  kind  of  models  that  should  be  studied  — 
vector,  the  physical  world  model,  the  relative  motion  world  model, 
etc. 

A  study  more  closely  related  to  AAW  is  concerned  with  methods 
of  training  programers  for  BTIS.  Many  senior  officers  with  no 
engineering  background  have  been  having  difficulty  with  this  course . 
We  were  asked  to  determine  whether  a  method  of  instruction  could  be 
devised  to  help  this  group.  The  study  can  be  considered  as  a 
compaalon  to  the  atteogjt  of  Rlgney’s  group  to  develop  aptitude  tests 
for  the  selection  of  programer  trainees.  Dr.  John  Meyer  of  my  staff 
took  the  course  to  get  eome  ideas  on  this  prob.lem.  On  the  beisis  of 
his  observations,  a  program  is  being  initiated  which  includes  what 
seems  to  be  a  universal  problem  in  training  —  deriving  explicit 
statements  of  objectives  —  as  well  as  experiments  in  the  NIRL 
laboratorv.  We  are  nlannlng  to  study  the  Influence  of  the  amount 
of  practice  and  techniq,ues  for  promoting  active  student  participa¬ 
tion  on  learning  to  code  and  to  flow  dliagram. 

Practice  was  selected  as  one  experlmoital  variable  because  of 
the  observation  that  sane  students  become  lost  early  in  the  course 
and  never  do  catch  up.  More  practice  and  Instructional  time  me^  be 
needed  by  students  who  have  not  had  experience  which  makes  it 
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possible  to  think  In  the  explicit  -my  demanded  by  flov  charting  and 
coding. 

Technlqiues  for  promoting  student  participation  vas  selected  for 
study  on  the  basis  of  the  observation  that  in  review  and  discussion 
sessions  of  the  course  there  was  little  student  participation, 
perhaps  because  those  ^o  had  no  problem  saw  no  need  for  questions, 
and  those  who  were  having  troubles,  had  Insufficient  grasp  of  the 
subject  matter  to  be  able  to  fomulate  questions.  A  technique  for 
pjxunotlng  student  participation  In  small  groups  will  be  compared 
with  the  current  method  of  instructor  presentation  and  discussion 
In  the  large  classroom  setting. 

As  I  have  said,  these  efforts  are  but  Indirectly  related  to  opera¬ 
tional  AAW .  It  is  hoped  they  will  provide  the  background  needed  to 
understand  the  AAW  problem  and  lead  to  more  relevant  studies  of 
team  training  in  the  NTDS  setting,  supplemented  by  appropriate 
laboratory  studies. 


B-34 


study  of  Generalized  Decision-Making  Skills 
(NTDC  Project  7576) 


Raymond  C.  Sidorsky 
General  Dynamics /Electric  Boat 


I'm  going  to  report  on  the  progress  of  a  research  program  at  Electric 
Boat  supported  by  the  Naval  Training  Device  Center, 

The  overall  purpose  of  this  project  is  to  provide  empirical  founda¬ 
tions  for  the  training  of  decision-making  behavior.  More  specifically,  to 
identify  by  operational  definition  those  aspects  of  decision-making  behavior 
used  in  AAW  and  ASW;  to  determine  empirically  which  aspects  are  most 
responsible  to  training;  and  to  determine  empirically  which  aspects  are 
generalizable  or  specific  to  the  task  at  hand.  Our  efforts  to  date  have  in¬ 
cluded  information  gathering  from  NWPs,  NWIPs,  and  other  naval  publica¬ 
tions,  interviews  and  discussions  with  present  or  former  naval  officers 
knowledgable  in  AAW  and/or  ASW,  and  analytical  study  of  the  fundamental 
nature  of  military  decision-making  tasks. 

In  keeping  with  our  charter  from  NTDC,  we  have  endeavored  to 
maintain  a  global  approach  to  the  general  problem  of  decision-making 
rather  than  addressing  ourselves  to  the  detailed  characteristics  of  specific 
tactical  situations  or  operations.  To  this  end  we  have  defined  our  initial 
problem  as  the  determination  of  what  decision-makers  are  required  to  do 
in  relation  to  an  actual  or  potential  enemy  rather  than  a  determination  of 
what  they  should  do  or  of  how  they  should  do  it.  In  other  words,  the  re¬ 
sults  of  this  first  phase  of  the  program  will  be  by  and  large  descriptive  in 
nature. 
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For  purpose  of  this  study,  military  decision-making  is  defined  as 
the  manifest  assumption  of  responsibility,  based  on  vested  or  implied 
authority  for  the  selection  of  a  particular  course  of  action  from  among  a 
known  group  of  alternative  actions  which  is  intended  to  and  capable  of 
affecting  the  course  of  events  related  to  an  actual  or  potential  enemy  in 
such  a  way  as  to  best  satisfy  some  end  or  goal.  Further,  in  order  to  pro¬ 
vide  a  practical  set  of  boundary  conditions  to  the  tasks  which  will  be  con¬ 
sidered,  a  set  of  initial  assumptions  was  developed  as  the  context  from 
which  decision  tasks  would  be  selected.  The  following  circumstances  were 
assumed: 

(1)  state  of  war  and,  therefore,  actual  or  potential  presence 
of  adversaries  with  objectives  opposed  to  own; 

(2)  presence  of  unit  or  group  of  units  capable  of  implementing 
successful  confrontation  of  the  enemy; 

(3)  existence  of  pre- determined,  specifiable  doctrines, 
strategies,  or  rules; 

(4)  existence  of  specific,  quantifiable  setting  in  time,  space, 
natural,  own,  and  opponent -engendered  environment; 

(5)  existence  of  a  unit  role,  defined  by  a  set  of  prescribed 
re  sponsibilitie  s; 

(6)  existence  of  reciprocal  understanding  of  units'  role 
responsibilities  and  the  expectation  of  performance  of 
sucii  responsibilities; 

(7)  presence  of  a  mission,  i.  e. ,  a  distinguishable  set  of 
activities  characterized  by  phases  in  which  a  unit  engages 
when  fulfilling  a  particular  goal  related  to  attaining  national 
objectives;  and 
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(8)  the  possibility  that  several  missions  may  operate 
simultaneously,  although  they  may  differ  in  priority. 

Our  initial  efforts  have  been  directed  toward  the  development  of  a 
conceptual  framework  which  will  permit  the  classification  of  decision¬ 
making  on  the  basis  of  objectively  defined  parameters.  This  endeavor  has 
reached  at  least  partial  fruition  through  the  evolution  of  ACADIA*  -  A 
Taxonomy  of  Military  Decision-Making.  The  rationale  which  has  led  to 
the  development  of  the  ACADIA  system  is  based  on  the  postulate  that 
military  (as  well  as  other)  decisions  can  be  logically  and  usefully  cate¬ 
gorized  on  the  basis  of  the  dynamics  involved  in  the  relationship  between 
combinations  of  pairs  of  the  three  basic  determinamts  inherent  in  a  deci¬ 
sion  task,  viz:  self,  i.  e.  those  aspects  or  attributes. related  to  or  under 
the  control  of  the  decision-maker,  enemy,  i.  e.  the  external  agent  or 
entity  to  which  own  self  must  relate  to  achieve  some  objective,  and  the 
interface,  i.  e.  those  aspects  of  the  physical  environment  through  which 
various  forms  of  interaction  occur  (data  acquisition,  physical  contact, 
etc. ).  The  postulation  of  these  three  elements  has  been  derived  by  induc¬ 
tion  from  the  data  gathered  in  the  course  of  the  literature  review  and  inter¬ 
view  processes. 

In  the  ACADIA  schema,  a  decision  is  viewed  as  an  action  resulting 
from  an  individual's  attempt  to  best  relate  to  external  entities  or  agents  to 
achieve  some  desired  end  based  on  perceived  or  expected  relationships 
between  self  and  the  external  entity.  The  nature  of  this  response  is  deter¬ 
mined  by  the  particular  combination  of  determinants  operating  in  a  given 
situation.  Thus,  decision-making  is  defined  in  terms  of  empirically  ob¬ 
servable  characteristics  of  the  decision  situation.  As  a  consequence, 

♦  Acronym  derived  from  the  basic  decision  classes  of  Acceptance  Change, 
Anticipation,  Designation,  implementation,  and  Adaptation. 


decision-making  is  treated  not  as  a  process  but  as  a  response  which  exists 
only  in  its  manifestation.  On  this  basis,  six  decision  types  have  been 
delineated,  viz: 


Decision  Task  Determinants 


Source  of  Criterion  of  Decision-Maker's 

Uncertainty  Response  Expressed  in  Terms  of 


Acceptance 

interface 

enemy 

Change 

self 

interface 

Anticipation 

enemy 

interface 

Designation 

interface 

self 

Implementation 

self 

enemy 

Adaptation 

enemy 

self 

An  additional  task  to  which  we  are  addressing  ourselves  is  the 
development  of  a  coding  system  to  provide  a  convenient  method  by  which 
military  decision  tasks  can  be  analyzed  and  regrouped.  This  coding  sys¬ 
tem  is  intended  to  permit  determination  of  commonalities  inherent  in 
superficially  disparate  situations  to  which  a  common  training  procedure 
can  be  applied. 

At  present,  characteristics  of  military  decision  tasks  are  being 
analyzed  in  terms  of  a  number  of  different  dimensions  to  provide  a  multi¬ 
dimensional  framework  for  the  projected  coding  system.  In  addition  to  the 
basic  ACADIA  categorization,  the  applicability  of  following  dimensions  to 
the  derivation  of  a  meaningful  schematic  is  being  investigated. 
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A.  Situational  Characteristics  including: 
Time 
Space 
Data 


a  priori 


J  fixed 
(__varying 


emergent 


Response 

Feedback 


B.  Contextual  Elements  including: 

Self  identities 
Enemy  identities 
Goals 
Values 

Probability  characteristics 
Costs 

Capabilities 

To  summarize,  then,  the  analytic  portion  of  the  study  we  are  con¬ 
ducting  at  General  Dynamics /Electric  Boat  for  the  Naval  Training  Device 
Center  has  as  its  goals: 

(1)  The  development  of  a  logical  and  useful  categorization  of 
military  decisions. 

(2)  A  schema  whereby  communalities  in  various  types  of  decision¬ 
making  can  be  isolated  for  the  purpose  of  training. 
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(3)  Empirical  determination  of  the  relationships  between  the 
decision  maker  and  the  external  world  as  pertaining  to 
military  decisions. 

(4)  Recommendations  as  to  training  procedures  and  training 
device  designs  necessary  to  provide  fruitful  training  for 
decision  making. 

In  addition  to  these  analytic  aspects,  the  research  being  coiiducteci 
under  the  auspices  of  the  Naval  Training  Device  Center  includes  a  program 
of  experimental  studies.  The  general  objective  of  this  phase  of  the  project 
is  to  provide  data  on  the  human  learning  of  decision  tasks  which  can  be 
applied  to  the  design  and  employment  of  training  equipment. 

The  empirical  studies  are  being  implemented  through  the  use  of 
SUBTAG,  the  Electric  Boat  SUBmarine  Tactics  Analysis  and  Gaming 
Facility. 

SUBTAG  is  a  man/machine  gaming  facility  which  employs  analog 
computerization  to  provide  dynamic  simulation  of  various  situational 
parameters.  It  is  thus  capable  of  presenting  a  wide  variety  of  tactical, 
i.  e.  decision-making  situations  under  "realistic"  conditions.  Physically, 
the  facility  is  composed  of  two  major  areas,  one  containing  operator  con¬ 
trol  stations  (booths),  the  second  contadning  equipment  and  displays  for 
experimenter  control  purposes.  An  overview  of  the  facility  is  shown  in 
Figure  1. 

The  command  station  area  is  composed  of  five  stations  or  booths, 
each  containing  a  console  (Figure  2).  Each  console  is  provided  with  dis¬ 
play  indicators,  controls,  and  communications  equipment.  The  experi¬ 
menter's  control  area,  located  in  a  room  adjoining  the  command  booth 
area,  is  equipped  with  a  multi- coded  situation  display,  control  and  moni¬ 
toring  equipment,  data  collection  equipment,  and  the  central  communica¬ 
tions  panel  (Figure  3).  Analog  computers  for  the  provision  of  dynamic 
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FIGURE  I  SUBTAG  FACILITY  ARRANGEMENT  PLAN 
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simulation  are  also  located  in  this  area.  Signal  flow  between  the  subjects, 
experimenters  and  the  equipment  is  shown  schematically  in  Figure  4. 

As  I  mentioned  earlier,  the  command  booth  area  is  composed  of 
five  identical,  but  isolated  booths.  Each  booth  contains  a  console  which 
Includes  a  plotter  and  plot  generation  equipment,  a  control  and  display 
panel,  and  a  communications  system  (Figure  5). 

The  facility  is  designed  to  permit  the  experimental  manipulation  of 
a  number  of  Independent  situational  variables  (Figure  5a)  which  include, 
but  are  not  limited  to: 

(1)  Vehicle  number  and  type  (5)  Detection  capabilities 

(2)  Communications  (6)  Weapon  capabilities 

(3)  Time  scale  (7)  Pre -programming 

(4)  Environmental  characteristics 

(1)  Vehicle  number  and  type 

Five  vehicles  or  groups  of  vehicles  can  be  simulated  dynamically 
within  the  facility.  These  can  represent:  ships,  aircraft,  helicopters, 
land  vehicles,  missiles,  mobile  radar,  direction  finding  stations  or  other 
vehicles  or  stations.  Vehicles  or  objects  that  do  not  require  dynamic  con¬ 
trol  may  be  "played",  i.  e.  represeAted  in  their  outputs,  by  the  experi¬ 
menters. 

(2)  Communications 

Experimental  control  of  communications  permits  a  means  whereby 
information  transmission  can  be  manipulated.  Verbal  communications 
can  be  effected  in  any  combination  from  subject  to  subject  and  from  sub¬ 
ject  to  experimenter.  The  "security"  of  communications  can  be  controlled 
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as  can  the  detectability,  length  of  transmission,  and  other  operational 
constraints.  A  two  channel  ttqje  recorder  provides  complete  communica¬ 
tion  data  collection. 

(3)  Time  scale 

Experimental  decision-making  situations  can  be  presented  under 
real-time  or  various  levels  of  slow  or  accelerated-time  conditions.  This 
capability  makes  it  possible  to  determine  the  effects  of  the  relative  speed 
with  which  events  occur  (all  other  factors  being  held  constant)  in  order  to 
establish  the  significance  this  variable  may  have  in  training  situations.  It 
is  obvious  that  if  the  time  scale  can  be  accelerated  appreciably,  a  great 
savings  in  training  time  will  result.  However,  this  savings  will  only  re¬ 
sult  if  it  is  empirically  established  that  decision- msdcing  behavior  does 
not  differ  qualitatively  as  a  result  of  variations  in  time  scale. 

(4)  Environmental  characteristics 

Among  environmental  parameters  that  can  be  manipulated  as  in¬ 
dependent  variables  are  sea  state,  land  cover,  atmospheric  conditions, 
bathythermographic  conditions,  etc.  Moreover,  characteristics  of  geo¬ 
graphical  stimulus  configurations  can  be  represented.  Land  masses, 
underwater  obstacles,  and  topographical  features  may  be  varied  indepen¬ 
dently.  Considerable  variation  in  the  geographic  scale  is  possible;  the 
distance  represented  by  a  side  may  range  from  10  to  500  miles,  for 
example. 

(5)  Detection  capabilities  of  vehicles 

Detection  capability  cannot  be  considered  strictly  as  an  independent 
variable  since  it  is  itself  influenced  by  environmental  conditions  such  as 
those  mentioned  above.  However,  types  of  detection  equipment  available 
may  be  varied,  and,  within  the  constraints  imposed  by  the  environment. 
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potential  capabilities  may  be  specified.  Outputs  from  gear  such  as  radar, 
sonar,  ECM,  MAD,  and  periscope,  as  well  as  from  unaided  Visual  systems 
can  be  presented  to  subjects. 

(6)  Weapon  capabilities  of  vehicles 

The  number,  type,  range,  and  speed  characteristics  of  weapons 
available  can  be  varied  by  the  experimenter  although  actual  selection  and 
employment  of  weapons  is  determined  by  the  subject.  The  subject  receives 
Information  concerning  his  capabilities  from  verbal  communications  occuring 
prior  to  the  problem.  He  selects  weapons  and  provides  parameters  relevsuit 
to  their  firing  via  the  communications  network  and  is  informed  of  the  results 
of  his  actions  by  the  same  means.  Weapons  which  can  be  employed  include: 
torpedoes,  hedgehogs,  depth  charges,  bombs,  missiles,  anti-aircraft  fire, 
mines,  etc. 

(7)  Pre -programming 

The  facility  provides  the  capability  for  pre-programming  the  actions 
of  any  number  of  the  dynamic  operator  stations  by  means  of  a  Flexowriter 
punch  tape  and  five  tape  readers  connected  to  the  input  channels  of  the  five 
stations.  This  capability  permits  the  presentation  of  identical  complex 
tactical  situations  to  several  different  individuals,  or,  if  desired,  to  the 
same  individual  on  different  occasions.  A  means  is  thus  available  to  re¬ 
duce  both  experimenter  error  to  a  minimum  and  to  provide  a  completely 
controlled  basis  for  establishing  the  stability  of  operator  responses  to 
various  situational  parameters. 

In  another  vein,  the  SUBTAG  facility  provides  a  means  for  research 
on  an  additional  facet  of  training  for  decision-making.  There  are  several 
levels  of  simulation  abstraction  which  can  be  derived  from  the  usage  of  the 
facility.  The  most  obvious  is  the  utilization  of  the  facility  to  achieve  the 
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maximum  possible  correspondence  to  the  actual  military  system.  While 
SUBTAG  does  not  simulate  the  actual  physical  environment  of  the  decision¬ 
maker  (submarine  control  room,  CIC,  as  examples),  it  does  provide  him 
with  the  information  necessary  and  sufficient  to  accomplish  a  given  mission. 
From  this  level  of  maximum  "realism",  it  is  possible  to  remove  certsdn 
qualifies  of  the  simulation  in  order  to  evaduate  the  effects  of  the  level  of 
abstraction  of  the  training  situation  upon  decision  making  performance. 

For  example,  the  dynamic  movement  can  be  removed  and  the  attributes  of 
the  more  abstract  "maneuvering  board"  simulation  can  be  effected  and 
evaluated. 

We  have  recently  started  the  experimental  portion  of  our  research 
program.  The  initial  series  of  studies  is  concerned  with  factors  involved 
in  decision-making  of  the  Implementation  type  in  the  ACADIA  schema. 

The  essential  task  of  the  decision-maker  is  to  "implement"  a  course  of 
action  (fire  a  weapon)  as  a  function  of  (conditioned  by)  the  momentary  rela¬ 
tionship  between  his  own  amd  an  enemy's  probability  of  success,  both  of 
which  vary  (increase  monotonically)  as  a  function  of  time. 

The  independent  variables  which  will  be  manipulated  systematically 
include: 

(1)  The  time  scale  involved  in  the  dynamic  development  of 
the  situation 

(2)  The  perceived  (displayed)  rate  of  change  of  relative  probability 
of  success  of  self  and  enemy 

(3)  The  rate  of  motion  of  the  enemy  target(s) 

(4)  The  number  of  targets  under  simultaneous  surveillance 
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(5)  Incorrect  information 

(6)  Ambiguous  information 

The  contextual  background  for  this  particular  series  of  experiments 
is  derived  from  the  following  considerations. 

Many  military  decisions  made  in  a  confrontation  of  the  enemy 
situations  involve  the  choice  of  the  "proper  time"  to  implement  some 
known,  specifiable  course  of  action.  As  examples,  a  weapons  direction 
officer  must  decide  the  "proper  time"  to  fire  a  missile  at  an  approaching 
enemy  aircraft,  a  S/M  skipper  must  decide  on  the  proper  time  to  fire  a 
torpedo  or  to  take  a  significant  tactical  action  such  as  active  pinging,  etc. 
These  situations  involve  basically  a  conflict  between  two  opposing  require¬ 
ments  involved  in  the  consequences  of  military  engagements  which  are  to 
(1)  destroy  the  enemy,  and  (2)  prevent  the  enemy  from  destroying  one¬ 
self  or  achieving  his  goal.  From  the  moment  a  contact  with  an  enemy  is 
established  a  dynamic  process  begins  such  that  the  decision  maker  permits 
the  situation  to  develop  over  time  to  the  point  where  an  available  course 
of  action  will  have  a  complete  or  maximum  chance  of  accomplishing  the 
mission.  The  reasons  for  permitting  time  to  pass  may  be  (1)  to  permit 
the  accumulation  of  more  amd/or  more  precise  data  regarding  the  target, 
and  (2)  to  permit  the  effective  range  to  decrease  (assuming  that  a  weapon 
or  ping  is  more  effective  as  range  is  reduced,  etc. ).  Thus,  if  the  D-M* 
allows  more  time  to  pass  he  increases  the  probability  of  success  of  the 
prescribad  course  of  action.  Ideally,  the  D-M  would  allow  the  situation 
to  progress  to  the  point  where  100%  success  was  assured,  i.  e.  fire  a 


♦  D-M  stands  for  Decision-Maker 
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torpedo  at  100  yds.  However,  the  situation  rarely  permits  this  course  of 
action.  Except  in  an  ideally  executed  and  completely  successful  ambush, 
the  D-M  is  normally  faced  with  the  fact  that  as  the  situation  progresses 
the  probability  of  success  of  the  enemy  in  detecting,  localizing,  and 
destroying  him  also  increases.  The  rate  at  which  the  enemy's  chances 
of  success  and  the  D-M's  chance  of  success  increase  are  not  necessarily 
equal  and  opposite  as  a  function  of  time,  do  not  vary  linearly  with  time, 
and  do  not  vary  in  the  same  manner  from  encounter  to  encounter.  Thus, 
the  D-M  is  faced  with  a  dynamic  situation  which  forces  him  to  make  a 
decision  with  regard  to  the  "proper  time"  to  execute  some  course  of  action 
which  maximizes  his  chance  of  success  and  minimizes  the  enemy's  chance 
of  success. 

The  situation  may  be  described  abstractly  in  the  following  manner 
using  a  spatially  varying  situation.  The  D-M  detects  the  presence  of  an 
enemy;  at  the  moment  of  detection  the  probability  of  success  is  zero  or 
very  low  (if  not  0  or  low  no  decision  is  involved  -  reponse  would  be  auto¬ 
matic  if  100%).  Assume  a  situation  in  which  the  probability  of  own  success 
increases  monotonically  with  time  (this  is  true  in  an  AAW  barrier  -  not 
necessarily  true  with  an  opening  target  in  S/M  ASW).  The  probability  of 
success  would  increase  as  a  function  of  a  variety  of  causes  such  as  in¬ 
creased  reliability  of  kill  as  a  function  of  target  range,  more  precise 
localization  of  target,  more  effectivfe  weapon  preparation,  etc.  However, 
the  effects  of  all  of  these  factors  can  bq  e]q>resseil  as  a  change  in  probability 
of  success  over  a  single  dimension- --ti,me.  Similarly,  the  ability  of  the 
enemy  to  destroy  the  D-M  can  be  expressed  as  a  function  of  time.  In  a 
military  decision-making  situation  the  probability  of  own  success  rarely 
reaches  100  before  the  enemy's  chance  of  success  reaches  a  value  above 
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zero.  (If  it  did,  no  decision  wruld  be  involved).  Thus,  the  D-M  is  faced 
with  the  dilemma  of  having  his  own  chance  of  success  increase  to  as  high 
a  value  as  possible  before  the  enemy's  chance  of  success  rises  to  too  large 
a  value.  The  situation  can  be  represented  graphically,  thus 
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Figure  6 


Tlie  essential  elements  of  this  situation  are: 
own  ship  location 
target  location 
range  to  target 

probability  of  own- success  (as  f  of  a  given  and/or  required 

course  of  action) 

probability  of  enemy  success 

change  in  above  ]»obabiljlties  as  f  of  time 

The  D-M's  task  is  to  select  the  optimum  combination  of  own  success 
vs.  enemy  success  probability  (which  occurs  at  some  point  in  time  between 
time  0,  zero  (initial  detection)  to  time  C  (100%  probability  of  success  of  either 
self  or  enemy)). 
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The  purpose  of  the  projected  experimentation  is  not  to  determine  how 
accurately  D-M  can  establish  the  optimum  ftame  theory  tactic,  i.e.  mathe¬ 
matically  optimum  solution  or  trade-off,  but  rather  to  obtain  data  about  how 
various  characteristics  of  this  situation  affect  the  D-M's  behavior.  For 
example,  it  is  possible  to  maintain  all  of  the  factors  involved  in  Figure  6 
above  constant  except  for  the  rate  at  which  the  target  progresses  from 
Time  0  to  Time  C. 

This  would  permit  one  to  determine  whether  D-M's  make  the  same 
decision,  i.e.  are  consistent  in  selecting  a  "proper  time"  in  different  mili¬ 
tary  situations  such  as  AAW  and  S/M  ASW  which  vary  essentially  only  in 
the  rate  at  which  relative  closure  occurs.  Information  regarding  this  char¬ 
acteristic  of  human  behavior  would  have  significant  implications  for  training 
device  and  procedure  design  since,  if  it  could  be  shown  the  D-M's  do  behave 
consistently  independent  of  time  scale,  then  it  would  be  possible  to  train 
decision-making  skills  in  a  limited  training  situation  with  assurance  that 
the  D-M  training  would  be  generalized  to  the  specific  situations  they  would 
face  in  their  respective  duties,  e.g.  Weapons  Control  Officer,  S/MC.O.,  etc. 

It  is  submitted  that  there  are  tactical  situations  in  which  the  decision 
maker  (e.g.  weapons  control  officer)  does  proceed  on  the  basis  of  such  a 
scale  which  is  a  composite  of  the  many  factors  which  enter  into  the  tactical 
situation.  The  more  skillful  he  is,  the  more  of  these  factors  he  can  incorpo¬ 
rate  into  his  "probability  scale"  and  the  greater  the  correspondence  between 
the  changes  in  his  subjective  probability  and  the  objective  probability  associated 
with  these  variables.  Now  the  subjective  scale  developed  by  the  decision 
maker  is  unique  to  each  confrontation,  i.e.  target,  because  each  target  has 
at  least  some  unique  characteristic  associated  with  it  (for  example,  if  two 
successive  targets  appear  which  are  identical  in  all  other  respects,  speed 
range,  bearing  weapons,  etc.  they  are  each  unique  since  the  response  to  #2 
is  conditioned  by  the  success  or  failure  of  the  response  to  #1).  The  point 
here  is  that  although  it  might  be  possible,  in  theory,  to  specify  the  physical 
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correlates  of  most  of  the  factors  which  affect  the  nature  and  form  of  the 
probability  of  success  scale,  in  practice  thus  would  be  very  difficult  if  not 
impossible.  However,  for  purposes  of  the  present  experiment,  the  specific 
characteristics  affecting  the  form  of  the  scale  are  essentially  irrelevant 
since  the  object  is  to  determine  characteristics  of  the  subjects  responses  to 
a  given  scale  (obtained  in  a  "meaningful"  context)  as  a  result  of  experimentally 
manipulated  situational  characteristics.  In  other  words,  data  regarding  the 
nature  rather  than  correctness  of  the  subjects'  behavior  is  the  object  of  the 
study. 

The  SUBTAG  facility  was  employed  for  this  first  study.  Each  of  the 
two  booths  used  contained  a  large  X-Y  display  upon  which  a  moving  target 
(pip  of  light)  was  presented.  On  either  side  of  the  X-Y  display,  digital 
readouts  indicate  the  momentary  probability  of  success  of  "own  ship"  (left 
readout)  or  of  the  "enemy"  (right  readout).  The  experimental  set-up  is 
shown  in  Figure  7 . 

Own  and  enemy  probabilities  increased  during  the  course  of  the  trial 
at  one  of  6  different  rates  as  shown  in  Figure  8. 

The  expression  of  the  rate  as  10/5,  for  example,  indicates  that  100% 
probability  of  success  was  reached  in  50  units  of  time  (100  units  of  time 
equalled  60  seconds).  There  was  a  systematic  change  in  the  rate  compari¬ 
sons  from  10/5  vs.  10/10  to  10/ 10  vs.  lO/lO.  In  one-half  of  the  experi¬ 
mental  trials  (22  in  all),  own  unit  possessed  the  rate  advantage,  and  in  the 
other  half,  the  enemy  unit  had  the  rate  advantage.  There  were,  in  addition, 
eighteen  masking  trials  in  which  there  was  no  consistent  advantage  for  either 
own  or  enemy  unit,  and  five  warm-up  trials . 
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Rate  of  Change  of  Probability  as  a  Function  of  Time 
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Feedback  was  given  after  each  trial.  The  subject  was  told  he  had 
scored  a  hit  or  had  missed.  Hits  were  determined  on  the  basis  of  the  com¬ 
parison  of  a  randomly  generated  number  with  the  probability  (own)  present 
at  time  of  firing.  Mutual  hits  were  not  allowed.  The  subject  was  not  told 
the  time  at  which  the  enemy  fired. 

Analysis  of  the  data  in  this  preliminary  experiment  resulted  in  the 
observation  that  the  subjects  fired  at  certain  particular  combinations  of  own  / 
enemy  probabilities,  i.e.  their  behavior  is  extremely  stereotyped  and  pre¬ 
dictable  particularly  when  own  unit  had  the  advantage.  A  slightly  greater 
amount  of  variability  occurred  when  the  advantage  was  with  the  enemy. 

Some  of  the  additional  results  are  presented  in  Figs.  9,  10,  11,  and 
12.  Figure  9  (means  of  data  from  three  Ss)  indicates  that  firing  time  selected 
(expressed  in  terms  of  own  probability  of  success)  decreased  as  the  ratio 
of  own  to  enemy  probability  of  success  decreased  from  2  to  1  (0  =  10/5,  E  = 
10/10)  to  1  to  2  (0  =  10/10,  E  =  10/5).  It  also  suggests  that  while  the  shape 
of  the  curve  was  consistent  over  the  4  days  on  which  data  were  collected, 
the  level  of  firing  times  differed  from  the  first  two  to  the  second  two  days, 
firing  on  the  second  two  occuring  consistently  earlier. 

Figs.  10  and  11  present  the  data  from  three  individuals,  plotted  with 
the  same  X  and  Y  units.  A  comparison  of  the  two  figures  indicates  that 
variability  increased  markedly  during  the  last  two  days,  both  within  the 
subject's  responses  across  the  series  of  experimental  values,  and  among 
subjects  with  respect  to  their  level  or  I’ange  of  responses. 
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Fig.  12  shows  a  comparison  of  mean  own  unit  probability  of  success 
at  time  of  firing  and  enemy  probability  of  success  when  enemy  had  comparable 
advantage.  The  enemy  datum  points  are  calculated  and  they  represent  the 
answer  to  the  question:  In  the  situation  wherein  the  enemy  unit  had  the  ad¬ 
vantage,  what  was  the  enemy's  probability  of  success  when  own  unit  fired? 

Or,  in  the  2  to  1  advantage  situation,  for  Instance,  how  high  did  the  subject 
allow  the  enemy's  probability  of  success  to  rise  (when  E  had  the  advantage) 
in  comparison  to  the  height  he  allowed  his  own  to  rise  before  firing  in  the 
situation  in  which  the  same  relative  advantage  was  in  his  favor? 

The  data  suggest  that  in  general  the  subjects  respond  inappropriately 
in  situations  where  the  enemy  has  an  advantage .  Specifically,  they  generally 
tended  to  "fire"  (in  situations  in  which  the  enemy  had  an  advantage)  at  a 
point  just  after  the  enemy  had  fired  (as  measured  by  their  own  response  in 
the  complementary  situation).  The  outcome  of  this  response  pattern  in  the 
long  run  would  insure  maximum  loss  to  self. 

The  technique  developed  in  the  above  experiment  has  significant 
methodological  implications  for  decision  making  research  if  further  analysis 
and  experimentation  substantiates  its  validity.  It  will  be  noted  that  the 
procedure  permits  an  evaluation  of  the  subject's  performance  against  an 
opponent  (himself)  whose  characteristics  (i.e.  strategy  and/or  tactics)  are 
empirically  observable.  This  makes  it  possible  to  circumvent  one  of  the 
fundamental  difficulties  inherent  in  Game  Theory  or  other  mathematical 
approaches  to  decision  making  research,  viz,  the  use  of  Game  Theory  as  a 
normative  model  implies  that  the  application  of  a  given  player's  "optimum 
strategy"  represents  his  most  rational  mode  of  behavior.  Actually,  the 
use  of  an  "optimum  strategy"  is  rational  only  if  the  decision  maker  knows 
or  perceives  the  enemy  as  more  clever  or  more  knowledgeable  than  him¬ 
self.  If  the  decision  maker  perceives  the  enemy  as  less  "clever"  or  less 
"lucky"  than  himself  the  use  of  the  mathematical  "optimum  strategy"  is 
actually  irrational  since,  if  he  is  able  to  outwit  the  enemy  the  decision  maker 
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Figure  12 

Comparison  of  Mean  Probability  of  Success 
at  Time  of  Firing  for  "Own  Ship"  and  "Enem- 


can  gain  more  than  the  "optimum  strategy"  would  permit.  The  problem  for 
the  experimenter  has  always  been  to  specify  the  characteristics  of  the  enemy, 
a  problem  which  has  usually  been  resolved  by  use  of  a  "rational"  mathematical 
model  to  describe  the  enemy's  response  characteristics.  However,  the  fact 
is  that  in  most,  if  not  all  military  situations,  the  decision  maker  is  opposed 
by  a  real  person  rather  than  a  mathematical  model.  This  real-person  enemy 
does  not  act  like  a  mathematical  model  and  the  decision  maker  knows  it.  The 
problem  for  the  experimenter  now  is  to  evaluate  the  adequacy  of  an  "irrational" 
decision  maker  vis-a-vis  an  "irrational"  opponent.  The  technique  developed 
in  the  present  experiment  permits  the  evaluation  of  the  adequacy  of  the  decision 
maker's  response  using  the  decision  maker's  performance  itself  as  the  criterion. 
The  Implications  of  this  methodology  will  be  explored  further  during  the  course 
of  this  project. 
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Effects  of  Structural  and  Environmental  Variables 


on  AANI  Decision  Making 

H.M.  Schroder 
and 

S.  Streufert 
Princeton  University 

Introduction »  The  Components  of  Information  Processing 

Decisions  •  no  matter  how  complex  or  simple  -  caui  be  described 
as  responses  of  the  decision  making  organism  to  environmental  or 
internal  stimulation.  What  kind  of  response  will  occur  depends  to 
a  large  degree  on  (a)  the  particular  constellation  of  stimuli  imping¬ 
ing  on  the  organism,  (b)  the  information  previously  amassed  by  the 
organism  (effects  of  training) ,  (c)  the  directionality  and  magnitude 
of  the  organism's  behavioral  orientation  (personality  or  behavior 
content  variables)  and  (d)  on  the  organization  of  the  organism's 
information  processing  components  (variables  concerned  with  the 
structure  of  the  organism) .  Most  action  decisions  will  probably  be 
a  function  of  some  interaction  of  all  four  determinants.  A  great 
number  of  psychological  investigations  hatve  been  concerned  with 
determinants  (b)  and  (c) .  Only  few  investigations  have  bean  con¬ 
cerned  with  the  effects  of  determinants  (a)  and  (d) ,  particularly  as 
they  interact  to  produce  decision  making  behavior.  The  plans  tor 
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the  research  discussed  in  this  paper  include  an  attempt  to  analyse, 
describe  and  predict  the  outcome  of  the  interaction  of  all  four 
determinants,  with  special  emphasis  on  the  effects  of  environmental 
(input)  and  structural  variables. 

Results  of  past  er^erimentation  with  these  variables  makes  it 
appear  highly  probable  that  the  quality  of  information  processing 
and  consequently  the  quality  of  decision  making  can  be  greatly 
inproved  by  a  coordinated  manipulation  of  the  above  determinants. 

At  the  Group  and  Environment  Design  Laboratories  at  the  Psychology 
Department  of  Princeton  university  information  processing  and 
decision  making  is  studied  in  a  number  of  simulated  environments. 

One  of  these  will  be  a  simulation  of  some  of  the  aspects  of  the 
anti  air  warfare  environment.  It  is  hoped  that  the  analysis  of  the 
con^nents  of  information  processing  in  this  environment  will  be  «si 
aid  towards  the  improvement  of  individual  and  group  performance  in 
that  situation. 

Characteristics  of  the  AAWF  Environment; 

The  decision  maker  in  the  anti  air  warfare  situation  is  required 
to  concern  himself  with  a  number  of  tasks.  At  the  initiation  of  the 
battle  he  is  not  aware  of  the  strategy  that  the  enemy  will  enqploy. 
Consequently  he  must  attenq^t  to  construct  for  himself  the  environment 
of  the  opponent.  This  environment  should  permit  certain  moves  ly  the 
eneny,  but  not  otherst  The  decision  maker  must  be  aware  of  the 
feasible  potential  strategies  the  eneny  might  en^loy  at  any  particu* 
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lar  time,  so  that  the  best  defensive  response  can  be  made. 

One  of  the  decision  areas  concerns  the  atten^t  to  elicit 
Informational  feedback  from  the  enemy.  For  Instance,  information 
may  be  gained  about  the  location  of  an  enony  by  turning  on  radar, 
but  at  the  same  time  information  about  the  fleet  location  is  given 
to  the  enemy  who  is  able  to  pick  up  the  radar  signal.  Certain 
environmental  conditions  would  favor  the  radar  “information  seeurch” 
response,  others  would  not. 

As  Information  about  enen^  moves  becomes  available  to  the  deci¬ 
sion  maker,  he  must  organize  this  information  to  gain  the  maximal 
possible  Insight  into  the  potential  strategy  of  the  eneo^.  In  other 
words,  he  must  make  a  set  of  hypotheses  about  the  moves  of  the 
opponent.  These  hypotheses  should  be  subject  to  change  as  further 
relevant  information  becomes  available.  Once  such  hypotheses  have 
been  made,  they  should  be  checked  for  applicability.  Such  a  check 
can  be  made  in  at  least  two  ways:  (1)  by  observing  the  changing 
environment  for  any  event  that  is  inconsistent  with  the  hypotheses, 
and  (2)  by  acting  on  the  environment  in  an  atteni>t  to  gain  further 
relevant  information. 

Once  the  hypotheses  have  been  made,  the  AAWP  forces  of  the 
fleet  must  be  deployed  in  such  a  way  that  optimal  success  probability 
is  assured.  The  organization  of  these  forces  should  remain  flexible 
to  a  degree,  so  that  changes  can  be  made  if  necessary  as  a  conse¬ 
quence  of  alterations  in  the  environment  or  new  insights  into  enen^ 
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strategy. 

In  more  general  terms  we  may  describe  the  AAHF  environment  as 
emergent,  as  having  many  degrees  of  freedom,  such  that  no  fixed  set 
of  operating  procedures  can  be  specified  for  effective  performance 
over  different  runs.  Information  load,  the  complexity  of  the 
available  Infomatlon,  and  noxlty  (stressing  aspects)  are  high* 

These  factors  are  Increased  by  the  limitations  In^osed  upon  the 
decision  maker  by  the  physical  capacity  of  the  available  equipment. 
Characteristics  of  Decision  Making  In  the  AAWF  Environment 
!•  The  Design  of  a  Simpler  Decision  Making  Environment 

A  simpler  war  simulation  was  designed  at  the  laboratories  at 
Princeton  University  to  measure  the  effects  of  personality  content, 
personality  structxure,  group  structure.  Information  load  and  other 
variables  on  the  quality  of  decision  making  by  participants  In  the 
simulation.  Subjects  (decision  makers)  were  presented  with  a  map  of 
a  fictional  Island  supposedly  occupied  by  an  eneny.  The  task  was  to 
remove  the  enemy  from  the  Island.  Resources,  locations  of  resources 
and  their  capacities  were  given  only  for  the  armed  forces  of  the 
subjects.  Similar  Information  about  the  eneny  was  not  available. 

So  far,  groups  of  four  decision  nakers  per  simulation  have  been  used. 
Information  about  eneny  moves  was  available  only  vdien  observation  of 
the  eneny  by  the  forces  of  the  subjects  was  possible,  or  vAien  the 
subjects  (decision  mr  rs)  had  In  some  fashion  provided  for  an 
observation  of  certain  enemy  moves. 
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2.  Experimental  Variation  in  the  War  Game  Simulation 

So  far  only  a  few  of  the  potential  variables  affecting  informa¬ 
tion  processing  in  this  single  war  g2Sne  simulation  have  been  explored. 
Additional  experiments  are  now  in  preparation.  Differences  in  the 
quality  of  decision  making  have  been  found  on  the  basis  of  differences 
in  environmental  complexity,  in  personality  structiire  of  the  decision 
makers,  and  in  the  stressing  aspects  of  the  environment.  The  first 
two  of  these  variables  will  be  discussed  below: 

(a)  Experimental  variation  of  environmental  complexity 
A  number  of  previous  experiments  (e.g.,  Driver,  1962;  Tuckman, 
1963)  had  shown  that  decision  making  in  such  tasks  as  an  inter  nation 
simulation  and  a  stock  market  game  consistently  varies  as  a  function 
of  the  complexity  of  the  simulated  environment.  Both  above  and 
below  optimal  levels  of  environmental  complexity  appeared  to  depress 
the  quality  of  information  processing.  To  establish  whether  a  curvi¬ 
linear  relationship  of  environmental  complexity  to  quality  of 
Information  processing  would  hold,  decision  makers  in  this  simple 
war  game  were  exposed  to  a  simulated  environment  which  varied  greatly 
over  time  in  the  richness  of  availed»le  information.  The  simplest 
form  of  variation  in  information  complexity  was  used:  differing 
number  of  information  units  fed  to  the  subjects  per  time  unit. 

Quality  of  decision  making  was  measured  in  terms  of  the  integration 
of  the  decisions  into  meaningful  and  purposive  strategies.  For 

example,  any  isolated  move  vhich  was  unrelated  to  any  other  move  in 
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past  or  future  and  vdtich  could  be  seen  as  constituting  a  part  of  a 
transcending  purpose  received  a  high  score.  In  other  words,  decision 
makers  vdio  responded  to  the  environment  by  integrating  informational 
feedback  from  diverse  sources  and  across  time,  received  high  scores 
for  the  periods  in  which  such  strategies  were  «ig>loyed.  Decision 
makers  vdio  responded  to  the  environment  with  retaliatory  unrelated 
action  decisions  received  low  scores  for  periods  in  vAiich  only  such 
retaliatory  or  isolated  actions  occurred.  Ihe  U  curve  that  had  been 
suggested  by  the  findings  of  Driver  and  Tuckman  did  clearly  appear 
in  the  data  analysis.  Such  a  curve  is  shown  in  Fig.  1.  The  data 
represented  in  this  graph  are  mean  scores  for  six  runs  of  the  war 
game  simulation.  Information  Load  is  plotted  on  the  abcissa.  The 
load  varied  from  two  inputs  of  information  per  half-ho\ir  period  to 
40  inputs  per  half-hour  period.  Optimal  decision-making  quality 
(highest  degree  of  differentiation  and  integration  involved)  was 
achieved  for  information  loads  of  ten  Inputs  per  half-ho\u:  period. 
Both  very  low  information  load  (two  Inputs  per  half-hour  period), 
and  very  high  Information  load  (40  inputs  per  half-hour  period) 
resulted  in  sinpler,  less  effective  decision  making  in  all  groups. 

Me  can  see  from  previous  experiments,  and  fr<xn  this  experiment 
involving  a  sinqpler  war  game  simulation,  that  information  load  should 
be  optimal  in  order  to  produce  optimal  decision  making.  This  finding 
may  well  have  important  implications  in  the  AAWF  environment. 
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(b)  Experimental  variation  of  personality  structure 
Harvey «  Hunt  and  Schroder  (1961)  and  Schroder,  Driver  and 
Streufert  (1963)  have  proposed  conceptual  structures  as  determining 
the  Information  processing  characteristics  of  organisms.  Such 
organisms  may  be  individual  decision  makers,  or  groups  involved  in 
a  decision -making  taidc.  Their  structure  is  measured  in  terms  of 
the  level  of  integrative  con^lexity  of  information  processing. 
Integrative  complexity  ixi^lies  not  merely  the  capacity  to  organize 
incoming  information  into  the  components  of  the  environment 
(differentiation) ,  and  compare  and  combine  these  conponents  into  new 
readings  of  the  envlrotunent  as  a  basis  of  action  decisions.  It 
implies  also  flexibility  of  such  readings.  Consequently,  an  inte- 
gratively  complex  systm  is  able  to  adapt  quickly  to  environmental 
charges  without  necessarily  changing  the  readings  of  all  environ¬ 
mental  con^nents.  An  Integratlvely  sinqple  system  is  less  adaptive, 
since  either  a  change  of  such  readings  will  not  occur  at  all,  once 
a  reading  has  been  established,  or  the  entire  system  of  readings 
mtsy  have  to  be  changed. 

A  nunA>er  of  experiments  have  shown  either  lack  of  change  in 
interpretation  of  the  environment  or  extreme  change  with  change  in 
the  environment  for  persons  or  groups  described  as  integratlvely 
simple  (cf.,  Streufert,  1962). 

Integrative  con^lexity  of  decision  makers  was  varied  in  the 
simulated  war  game  described  above.  (Srov^  m«nbers  were  selected 
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to  form  homogeneous  groups  of  Integratlvely  complex  (abstract)  and 
Integratlvely  single  (concrete)  decision  makers.  Again  information 
load  was  varied  as  described  above.  It  was  predicted  that  the 
quality  of  performance  (the  level  of  Integration  in  decision  making) 
would  be  low  for  both  kinds  of  groups  iidien  environmental  con^lexlty 
is  too  high  or  too  low.  It  was  also  predicted,  that  integratlvely 
complex  persons  would  achieve  a  much  higher  level  of  performance 
than  integratlvely  single  persons  idien  environmental  conqplexity  was 
optimal • 

The  findings  of  this  experiment  are  in  part  demonstrated  by 
Figures  2,  3,  and  4*  Figure  2  is  a  plot  of  decisions  made  by  a 
group  consisting  of  persons  described  as  integratlvely  ccmqplex. 

The  decision  made  are  listed  vertically.  Time  is  plotted  hori¬ 
zontally.  Any  decision  is  allocated  a  point.  A  horizontal  llna 
connecting  points  shows  repetition  of  simileu:  decisions.  A  ver¬ 
tical  line  occurs  whenever  a  nuinber  of  decisions  were  made  at  the 
same  time.  Whenever  a  decision  is  meaningfully  related  to  a 
previous  or  future  decision  (as  described  earlier)  it  is  connected 
with  that  decision  by  a  diagonal  line.  A  diagonal,  therefore, 
represents  a  single  integration  of  action  decisions.  The  more 
diagonals,  the  more  integrations.  The  greater  the  ntmiber  of  diago¬ 
nals  which  join  at  one  and  the  same  point,  the  more  decisions 
represent  more  complex  information  processing.  The  longer  one  can 
follow  diagonal  connections  from  point  to  point  etc.,  the  greater 
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the  time  span  over  v^ich  feedbacdc  Is  being  utilized  and  integrated. 

The  various  period ,  -'.n  the  war  game  -  s^arated  in  Figures  2 
and  3  from  each  other  by  horizontal  lines  -  represent  periods 
varying  in  information  load.  The  game  was  begun  with  10  inputs 
per  half  hour,  then  2  inputs,  etc.,  in  increasing  order  to  40  inputs. 

Figure  3  is  a  plot  of  decisions  made  by  a  group  consisting  of 
persons  described  as  integratively  single.  Its  construction  is  in 
all  its  aspects  Identical  to  the  above  discussed  Figure  2.  A  com¬ 
parison  of  the  two  plots  shows  clearly  the  difference  in  the  nuniber 
and  pattern  of  diagonals  (Integrations)  between  the  two  groups  of 
subjects.  The  group  of  decision  makers  described  as  integratively 
complex  shows  a  much  higher  number  of  diagonals  in  geone  periods  near 
optimal  environmental  complexity. 

Again,  as  in  Figure  1,  we  may  plot  the  quality  of  decision 
making  against  information  load.  This  has  been  done  in  Figure  4* 

We  now  have  a  set  of  U  curves,  two  of  these  representing  groups  of 
decision  makers  described  as  integratively  complex  (abstract) ,  two 
as  integratively  simple  (concrete) .  The  difference  in  the  peaks  of 
the  two  sets  of  curves  is  quite  irr^ressive.  Groups  consisting  of 
abstract  persons  show  a  much  higher  level  of  performance  to  criterion 
for  a  point  of  optxmal  environmental  con^lexity  than  do  groups 
consisting  of  concrete  persons.  This  difference  is  due  in  part  to 
the  enqphasis  on  high  level  strategy  in  the  determination  of  a  score 
on  the  "quality  of  decision  making"  dimension.  However,  even  if 
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simply  the  number  of  integrations  (number  of  diagonals  per  period 
in  Figures  2  and  3)  are  plotted  against  Information  load,  the  dif¬ 
ferences  between  the  groups  is  impressive.  In  no  case  do  teams  with 
concrete  members  outperform  their  abstract  counterparts.  Only  in 
one  case,  as  Information  load  is  extremely  high  (40  inputs  per 
half-ho\ir),  do  we  find  that  a  team  of  abstract  persons  drops  to  the 
performance  level  of  their  concrete  counterparts. 

Such  findings,  peurtlcularly  in  conjunction  with  similar  results 
in  a  number  of  other  experiments,  point  to  the  great  importance  of 
personality  structure  in  determining  performance  levels  in  a  complex 
task  requiring  flexibility  in  perception  and  performance. 

Further  runs  of  this  war  game  with  the  above  variables  and  other 
variables  are  now  in  progress.  It  is  likely  that  further  findings 
may  shed  even  more  light  on  the  significant  variables  involved  in 
the  cognitive  decision  making  process. 

3.  Decision  Making  Processes  to  be  Studied  in  the  AAWF  Enviroranent 

The  AAViF  Environment  will  be  studied  primarily  with  an  emphasis 
on  the  differentiation  and  integration  Involved  in  decision  making. 
This  analysis  of  differentiation  and  integration  will  tcOce  into 
account  both  variables  of  the  environment  (stimulus  complexity,  etc.), 
and  variables  concerned  with  the  structure  of  the  decision  making 
organism  (individual  or  group  of  decision  mdcers) .  The  first 
question  to  be  asked  in  the  research  program  is  concerned  with  the 
determination  of  the  necessity  c£  differentiation  and  integration 
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for  optimum  performance  in  the  AAWF  environment .  Does  an  integrative- 
ly  con^lex  organism  outperform  an  integratively  sinqple  organism  in 
that  environment?  If  the  tasic  performance  is  not  affected  by 
structural  variables,  or  if  environmental  stimulation  is  too  highly 
overloaded,  a  consideration  of  such  varit^les  may  have  little 
utility.  The  second  question  investigated  would  be  concerned  with 
the  environment  itself:  Can  simulation  from  the  environment  be 
presented  to  the  organism  at  an  optimal  level  of  complexity  so  that 
optimal  performance  can  be  expected?  Finally  we  may  raise  the 
question  vAiether  some  combination  of  Integrative  complexity  of  the 
organism  and  optimal  con^lexlty  of  the  environmental  stimulation  can 
be  determined  to  produce  optimal  decision  making  quality  as  required 
for  the  particular  AAKF  situation.  Experiments,  employing  a  simulated 
environment  with  many  of  the  qualities  of  the  AAWF  situation  will 
aim  to  determine  how  high  level  decision  making  can  be  facilitated. 
Such  facilitation  could  be  attempted  in  a  nuniber  of  ways: 

(a)  integration  of  feedback  from  the  environment  in  an  attempt 
to  construct  both  own  and  enmny  strategy  may  be  facili¬ 
tated  by  increasing  or  (more  likely}  reducing  environmental 
input  load  to  the  optimum.  This  could  be  achiex’ed  through 
redesigning  of  dii^lays  which  would  then  assist  in 
infoinnation  storage,  assist  in  ease  of  infomation 
differentiation,  and  assist  in  ease  of  information 
integration; 
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(b)  decision  makers  may  be  trained  to  maintain  an  optimal 
potential  of  integrative  complexity  in  information 
processing.  Limits  would  however  be  set  by  their  respec¬ 
tive  optimal  performance  levels.  The  aim  here  would  be 
to  train  individuals  to  be  aware  of  (sensitized  to) 
decrements  in  their  decision  making  processes  (due  to 
Information  overload  or  stress) ,  and  to  train  these 
Individuals  to  develop  strategies  for  keeping  environ¬ 
mental  input  optimal  with  minimal  loss  of  information,* 

(c)  attempts  will  be  made  to  train  decision  makers  to  monitor 
the  quality  of  their  information  processing  and  to  initiate 
procedures  (e.g.,  computer  decisions)  when  the  level  falls 
below  a  given  point; 

(d)  if  possible,  decision  makers  could  be  selected  so  that 
enviroi  mental  con^lexity  of  the  task  matches  their 
optimum  performance  level. 

It  is  recognized  that  not  all  potentially  proposed  changes  of 
the  AAHF  environment  or  personnel  are  feasible  in  all  cases  because 
of  other  Navy  requirements.  It  should  however  be  possible  to 
introduce  some  changes  that  would  lead  to  greater  performance 
quality  in  the  AANF  situation. 

At  the  present  time  equipment  is  being  installed  at  the  Group 
Design  Laboratory  at  Princeton  to  permit  the  simulation  of  the  major 
aspects  of  the  AAttF  envi.  nment.  A  nvmdder  of  runs  of  that  simu- 
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latlon  concerned  with  the  variables  discussed  above  are  planned  to 
be  Initiated  as  soon  as  Installation  Is  con^leted.  It  Is  hoped 
that  some  results  will  be  available  no  later  than  the  beflnnlng  of 
summer  1964. 
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PROBLEMS  OF  COMMANDER  INTERACTION  WITH 
STORED  LOGIC  MACHINES  IN  NAVY  AAW  OPERATIONS 

J.  W.  Gebhard  and  R.  M.  Hanes 
Applied  Physics  Laboratory 


Problem 


The  advent  of  computer  aids  in  tactical  command  action  is  imminent. 
This  has  raised  a  number  of  new  problems  in  man-machine  interaction.  Some 
of  these  problems  relate  to  commander  interaction  with  stored-logic  computer? 
for  conducting  Navy  AAW  operations . 

Review  of  Data 


APL  Studies 


Experiments  1  and  II. 

We  will  now  review  the  available  data  bearing  on  the  problem.  It 
will  be  seen  that  these  are'  largely  from  one  source --the  APL  series  of  studies 
of  tactical  command  decision.  In  two  simulation  experiments  designed  for 
another  purpose,  a  Standard  Operating  Procedure  (SOP)  for  organizing  and 
conducting  an  air  defense  operation  won  the  universal  approval  of  14  Navy 
officers  (1,2).  Nevertheless,  these  same  officers  during  the  air  battles 
clearly  took  over  control  from  the  SOP'and  made  most  of  the  decisions  them¬ 
selves  as  measured  by  the  various  commands  given  to  the  weapons  systems. 
The  SOP  was  not  a  computer  program,  although  it  could  have  been,  and  the 
agents  carrying  out  the  SOP  were  people  and  not  an  electronic  computer.  It 
was  thought,  therefore,  that  the  commanders  might  have  distrusted  civilians 
to  work  according  to  an  agreed-upon  SOP,  but  that  they  might  have  trusted 
a  computer  to  carry  out  a  stored  logic  program. 
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Experiments  III  and  IV» 

Therefore,  It  was  decided  to  simulate  a  computer  by  deriving  the 
logical  outcomes  of  applying  a  set  of  rules  to  the  air  battle  inputs.  The  rules 
of  the  program  were  given  to  the  commanders  for  study,  and  during  the 
games  the  outcomes  were  displayed  to  the  commanders  as  recommendations. 

As  indicated  above,  the  commander  was  shown  as  many  as  five  recommenda¬ 
tions  at  once.  Four  of  the  recommendations  were  statements  (in  abbreviated 
symbology)  such  as;  "Red  CAP  to  Racket  3  at  cruise  speed";  "Green  CAP  to 
Bogey  PAPA  1  at  dash  speed";  "Missiles  to  Bogey  OSCAR  2";  "Return  Yellow 
CAP  to  the  carrier".  The  fifth  recommendation,  when  made,  was  always 
the  same:  "Launch  CAP".  The  commander  had  a  keyset  with  five  buttons, 
one  for  each  recommendation.  By  pressing  the  appropriate  button  he  could 
reject  any  of  the  recommendations.  Failure  to  reject  meant  acceptance,  and 
at  30  sec.  following  the  recommendation,  the  command  was  automatically 
sent  out  on  the  communications  net.  The  buttons  on  the  keyset  were  lighted 
green  for  20  sec.  following  the  recommendation,  then  they  turned  yellow  for 
10  sec.  as  a  warning  that  time  was  running  out.  Then  they  went  out  or  were 
replaced  by  new  recommendations.  Pressing  the  button  turned  it  red, 
signaling  the  crew  simulating  the  computer  to  hold  action.  The  commander 
then  had  to  convey  verbally  his  desired  changes  to  the  Force  system.  The 
layout  of  this  system  is  shown  in  Figure  1 . 

In  the  first  computer  simulation  experiment  conducted  in  1962  (Experi¬ 
ment  in),  a  group  of  eight  professional  Navy  Cl  C  officers  and  evaluators  with 
the  rank  of  Commander  or  Lt.  Commander  served  as  the  Sector  Anti-Air  War¬ 
fare  Commanders  (3,  4).  After  practice  with  both  the  manual  and  machine  modes 
of  operation,  his  task  was  to  conduct  a  series  of  computer-aided  air  defense 
engagements  in  the  courtermeasures  environment.  In  this  experiment  a  single, 
general-purpose  program  was  written  by  analysts  to  handle  the  attacks. 
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Fig.  i  COMMUNICATIONS  NET  IN  THE  FORCE  AAW  SIMULATION 
CONDUCTED  IN  EXPERIMENT  III  AT  APL 
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The  second  computer  simulation  on  a  group  of  12  Navy  officers  was 
completed  in  September  1963  (Experiment  IV).  In  this  more  elaborate  experi- 
the  commander  had  to  base  his  choice  among  three  machine  programs  upon 
intelligence  information.  Two  of  the  programs  were  designed  to  be  specifically 
applicable,  one  to  a  single-prong  and  one  to  a  broad-front  attack.  The  third 
was  a  general  defense  much  like  that  used  in  Experiment  III.  This  work  will 
be  published  in  1964  (5).  The  following  pages  contain  selected  results  from 
Experiments  II  and  III. 

Comparison  of  Experiment  II  with  Experiment  III 

Table  1  shows  how  the  four  commanders  working  with  the  SOP  of 
Experiment  II  compare  with  the  eight  commanders  of  Experiment  III  who 
had  a  machine  program.  Under  all  conditions  it  is  seen  that  the  commanders 
issue  a  large  percentage  of  the  orders  assigning  weapons  to  targets.  The 
slower  attacks  in  the  clean  (no  ECM)  environment  represent  the  least 
difficult  situations.  Yet  even  here  the  commanders  giv6  nearly  half  the 
assignments  for  both  the  SOP  and  program  conditions.  Note  also  that  they 
treat  both  SOP  and  programs  in  nearly  the  same  way.  When  the  situation 
becomes  more  difficult,  as  in  the  ECM  environment  and  with  the  higher- 
speed  raids,  they  take  over  control  to  a  much  greater  extent  for  target  assign¬ 
ments.  This  tendency  to  assume  more  control  in  difficult  situations  increases 

with  the  difficulty  of  the  situation  for  both  SOP  and  program.  A  similar  result 

( 

has  been  reported  by  Sinaiko  (6).  The  results  also  show  that  in  the  ECM 
environment  the  commanders  rely  (trufet?)  on  the  machine  program  more 
than  the  SOP,  especially  for  CAP  speed  and  other  orders.  The  speed  orders 
determine  how  fast  the  CAP  will  fly  and  the  "other"  orders  consist  of  in¬ 
structions  to  return  to  CAP  stations  or  the  carrier,  etc.  The  data  bear  out 
the  commanders'  assertions  that  they  like  the  machine  for  "housekeeping" 
activities,  but  not  for  making  the  crucial  assignment  decisions,  especially 
when  the  going  gets  rough. 
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Table  I.  Commander  override  for  different  types  of  orders.  (Each 
entry  is  mean  %  of  orders  of  each  type  Issued  by  the 
_ commander. ) _ 


Envi¬ 

ronment 

Type  of 
Order 

Expt. 

(SOP) 

Targe  1 

Sneed 

1.8 

Expt. 

( Program) 

M  0.9 

11^  Expt .  III^ 

( Proeram) 

M_ 

Expt. 

(SOP) 

Clean 

Target 

48 

47 

60 

69 

CAP  speed 

56 

51 

56 

42 

All  other 

62 

45 

61 

28 

ECM 

Target 

81 

61 

85 

74 

CAP  speed 

70 

42 

67 

44 

All  other 

68 

44 

59 

21 

^Reference  2 
2 

Reference  3 
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Commander -Computer  Interactions  in  Experiment  III 

Number  of  target  orders  issued.  Table  II  is  a  comparison  of  the  mean 
number  of  orders  per  battle  issued  by  the  computer  when  operating  automatically, 
with  those  issued  by  the  computer-commander  team  for  various  conditions 
of  the  experiment.  It  is  to  be  noted  first  that  for  all  conditions  the  man- 
computer  combination  generates  more  orders  than  the  computer  does  alone. 

This  is  relatively  more  pronounced  in  the  fast  games,  although  the  absolute 
number  of  orders  given  in  the  fast  games  is  less  than  in  the  slow  ones  due 
to  the  difference  in  the  duration  of  the  games.  With  the  commander  in 
charge,  the  number  of  orders  issued  by  him  alone  is,  in  seven  cases  out  of 
12,  greater  than  what  the  computer  alone  would  issue.  The  effect  of  this  is 
to  disburden  the  computer  in  various  amounts  in  all  cases  but  two,  where 
the  computer  issues  more  orders  than  it  would  have  in  the  automatic  mode. 

Even  so,  the  computer  still  issues  a  large  number  of  orders  on  the  average, 
thus  making  the  man-computer  combined  averages  so  high.  The  effect  of 
this  on  communications  is  obvious. 

The  computer  alone  issues  about  the  same  number  of  orders  in  the  ECM 
and  clean  environments.  In  most  cases,  the  commander  issues  more  orders 
in  the  more  complex  ECM  condition.  This  causes  the  machine  to  follow  suit 
in  some  cases.  In  all  of  these  comparisons,  however,  there  is  an  interaction 
involving  tactics.  The  differences  between  the  ECM  and  clean  environments 
are  smaller  for  all  entries  in  the  table  under  the  4-prong  raids  than  they  are 
under  the  2-  and  1 -prong  conditions.  This  is  due  xo  the  cunTuolug  of  the 

2-  and  l“prong  raids  where  the  attackers  are  packed  more  closely  together. 

The  2-  and  1-prong  raids  are  especially  confusing  in  the  presence  of  jamming, 
and  the  commander  reacts  to  this  by  issuing  a  large  number  of  orders  in  an 
attempt  to  handle  the  situation. 
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Type  of  override  on  target  orders .  In  overriding  the  computer  the 
commander  could  1)  reject  a  recommendation  and  either  issue  a  substitute 
order  or  do  nothing;  2)  anticipate  a  recommendation  and  give  it  before  the 
computer  would;  and  3)  issue  substitute  or  different  orders  either  following 
a  rejected  computer  recommendation  or  at  any  time.  The  following  tables 
contain  statistically  significant  effects  that  involve  rejections,  anticipations, 
and  substitutions  for  specified  conditions  of  the  experiment.  Certain  of 
the  tables  have  been  arranged  on  the  same  pages  to  facilitate  comparisons  that 
will  be  discussed  shortly. 

Tables  III  and  IV  show  that  commanders  differ  in  how  they  interact 
with  the  automated  program  in  giving  target  orders  to  counter  the  high  speed 
attacks.  Since  no  data  are  presented  for  the  M  0. 9  attacks,  this  means  that 
no  significant  commander  differences  were  found.  Table  III  shows  that  re¬ 
jections,  anticipations,  and  substitutions  differed  significantly  for  the  first 
four  commanders  and  the  60  sec.  assessment  time  with  respect  to  counter¬ 
measures.  Table  IV  indicates  that  the  last  four  commanders  who  worked 
with  the  30  sec.  assessment  time  simply  differed  with  respect  to  each  other — 
by  a  factor  of  nearly  3  to  1  in  the  number  of  orders  issued. 

The  next  four  tables  are  arranged  on  the  same  page  to  show  how 
override,  as  measured  by  target  orders,  interacts  with  countermeasures .  Tables 
V,  VII,  and  VIII  show  an  interaction  with  countermeasures;  Table  VI  does  not. 

For  the  conditions  shown  in  Tables  V  and  VIII,  substantially  less  override 
occurs  in  the  clean  environment  .  Table  VII,  however,  shows  that  this  is 
not  always  the  case  as  indicated  by  the  interaction  with  tactics.  Under  all 
conditions  shown,  the  commanders  anticipate  the  computer  recommendations 
much  more  than  they  reject  them,  and  issue  in  addition  a  large  number  of 
substitute  target  orders  of  various  kinds  that  are  not  provided  for  by  the 
machine  program. 
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Table  III.  Individual  differences  in  type  of  commander  override  on 


target  orders  showing  interaction  with  countermeasures. 
(Each  entry  is  mean  number  per  game.) _ 


M  1.8  attacks, 
60  sec.  assess¬ 
ment  time,  com¬ 
manders  1-4 

Commi 

mders  and 

Countermeasures 

Tsrpe  of 
override 

1 

Clean  ECM 

2 

Clean  BCM 

3 

Clean  ECU 

4  ' 

Clean  ECM 

Mean 

Rejec¬ 

tions 

0  0 

1.3  0.7 

0.3  1.0 

0.5 

Antici¬ 

pations 

4.3  4.0 

1.7  0.7 

1.0  1.3 

2.5 

Substi¬ 

tutions 

EHRI 

9.3  5.7 

4.0  8.3 

2.3_..  6.3 

5.3 

1 

Mean 

7.2 

11.6 

8.4 

6.1 

i 

Table  IV.  Individual  differences  in  type  of  commeinder  override  on 
_ target  orders.  fEach  entry  is  mean  number  per  getme.) 


M  1.8  attacks. 

Commanders 

30  sec.  assess- 

5 

6  7 

8 

ment  time,  com¬ 
manders  5-8 

5.0 

7.2  14.0 

7.0 
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Table  V.  Type  of  commander  override  on  target  orders  as  affected  by 
_ countemeasures.  (Each  entry  Is  mean  number  per  game.) 


j 

Counter¬ 

measures 

Type  of  Override 

Rejec- 

1 

Anti cl- 

Substl- 

tions 

patlons 

tutions 

M  0.9  attacks. 

■■■■■■■ 

60  sec.  assess- 

Clean 

3.2 

ment  time,  com- 

manders  1-4 

ECM 

1.0 

3.5 

5.6 

Table  VI.  Tsrpe  of  commander  override  on  target  orders  for  a  condi¬ 
tion  of  the  experiment  showing  no  interaction.  (Each 
_ entry  is  mean  number  per  game.) _ _ 


Type  of  Override 

M  0.9  attacks. 

Rejection 

Anticipation 

Substitutions 

30  sec.  assess- 

ment  time,  com¬ 
manders  5-8 

0.5 

1.8 

5.6 

Table  VII.  Type  of  commander  override  on  target  orders  as  affected  by 
countermeasures  and  tactics.  (Each  entry  is  mean  number 
_ per  game. ) _ _ _ 


Counter¬ 
measures _ Tactics  and  Type  of  Override 


4-prone 

2' 

-prone: 

1 -prone 

M  1.8  attacks. 

IHBliBi 

HI 

wm 

m 

Re.1.  Ant.  Sub. 

60  sec.  assess¬ 
ment  time,  com- 

Clean 

0.8  2.0 

7.2 

0.8 

3.0 

3.2 

0.2  1.8  1.2 

manders  1-4 

ECM 

0^ 

6.8 

0.2 

2.8 

0.5  2.5  9.0 

«aaiMaiib>  Awmm 

i 

1 

0.6  2.6 

7.0 

0.5 

2.9 

3.8 

0.4  2.2  5.1 

Table  VIII.  Type  of  commander  override  on  target  orders  as  affected  by 
countermeasures  and  tactics.  (Bach  entry  is  mean  number 
_ per  game . ) _ _ _ _ _ 


«  / -  __ 

Counter¬ 

measures 

Rejec¬ 

tions 

Substi¬ 

tutions 

M  1.8  attacks, 

30  sec.  assess- 

lean 

0.3 

1.2 

4.2 

ment  time,  com¬ 
manders  5“8 

ECM 

C 

o 

o 

«> 

1 

1.6 

6.2 
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Imeract  ton  patterns  in  override  on  target  orders.  The  grouping  of 
Tables  lU  and  IV  and  V  -  Vni  permits  one  to  see  an  interesting  relationship 
between  the  conditions  of  the  experiment  and  the  nature  of  the  override.  It 
is  reasonable  to  suppose  that  the  60  sec.  computer  assessment  time  gives 
the  commander  a  better  opportunity  to  evaluate  the  situation  and  to  become 
dissatisfied  with  the  operations  of  the  system.  It  is  also  reasonable  to  believe 
that  the  high  speed  attacks,  where  much  occurs  quickly,  impress  the  commander 
with  the  sluggish  nature  of  a  system  in  which  new  information  is  "digested" 
by  the  computer  for  a  full  minute  before  action  is  recommended.  A 
comparison  of  Tables  III  and  IV  shows  that  the  complex  interactive  relation 
with  countermeasures  appears  where  the  assessment  time  is  long  rather  than 
short,  although  the  target  speed  is  the  same.  This  same  effect  for  the  M  0.  9 
targets  is  shown  in  comparing  Tables  V  and  VI  and  again  for  the  M  1.  8 
targets  in  comparing  Tables  VII  and  VIII.  Holding  assessment  time  constant 
at  60  sec.,  more  complex  interactions  are  shown  in  Table  VII  when  compared 
with  Table  V.  The  same  is  true  for  the  30  sec.  time  as  shewn  by  the  inter¬ 
action  seen  in  Table  VIII  but  not  in  Table  VI  where  the  speed  is  slow.  Table 
VII,  where  the  assessment  time  is  long  and  the  target  speed  is  such  as  to  call 
for  vigorous  action,  contains  the  most  complex  interaction  of  all. 

It  appears,  therefore,  that  when  enemy  action  develops  rapidly  (M  1 . 8 
raids)  with  respect  to  computer  assessment  time  (60  sec. ),  the  pattern  of 
override  is  aiffected  by  more  factor^. 
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Summary 

Professional  Navy  evaluators  were  willing,  in  a  simulated  AAW  situa¬ 
tion,  to  cooperate  in  various  degrees  with  an  experimental  system  of  automated 
decision-making.  While  some  officers  effectively  negated  the  use  of  the 
computer  by  issuing  large  numbere  of  anticipatory  and  substitute  orders,  no 
one  turned  the  computer  off.  The  concensus  was  that  the  computer  was  most 
valuable  as  a  back-up  to  the  commander,  and  that  it  was  most  acceptable 
for  its  housekeeping  functions.  It  was  less  satisfactory  for  making  critical 
weapons -to -target  assignments,  establishing  the  pace  of  the  battle,  and 
determining  the  defensive  posture  of  the  Force  weapons  systems.  In 
particular,  commanders  objected  to  elements  in  the  logical  program  that  led 
to  early  depletion  of  their  CAP  reserves,  and  tactics  that  reduced  their 
ability  to  handle  a  second  strike,  or  tended  to  leave  their  flanks  exposed. 

While  unanimity  was  not  expressed,  the  system  that  automatically  put  non- 
rejected  recommendations  into  effect  as  orders  was  generally  liked,  and  it 
was  felt  that  the  machine  should  "force"  the  commander  by  placing  a  limit 
on  his  time  for  evaluating  recommendations.  It  was  agreed  that  working  with 
a  mach’ne  aid,  as  simulated  in  the  laboratory,  was  a  rewarding  experience, 
and  that  automation  in  decision-making  will  be  acceptable  to  most  commanders 
in  Force  AAW  operations  providing  adequate  provision  is  made  for  controlling 
the  computer. 
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TRAINING  IN  DECISION-MAKING 


R.  G.  Kinkade 

AIRCRAFT  ARMAMENTS,  INC. 


One  of  the  primary  missions  of  an  AAW  command  is  to  defend 
against  an  air  attack.  However,  a  collateral  mission  is  to  deter  such  an  attack. 
Success  in  accomplishing  the  collateral  mission  results  in  a  condition  whereby 
an  effective  AAW  system  is  seldom  employed  in  a  combat  situation. 

The  Commander  or  Staff  Officer  who  is  responsible  for  evaluating 
the  threat  from  a  potential  enemy  may  find  that  he  is  more  concerned  with  infor¬ 
mation  about  housekeeping  functions  than  he  is  about  the  enemy  when  the  system 
is  in  the  standby  mode.  Under  these  circumstances,  tactical  information 
probably  is  not  directly  impactive  on  the  evaluator. 

If  an  attack  does  occur,  the  evaluator  must  be  able  to  chcuige  the 
focus  of  his  attention  and  immediately  assess  the  threat  to  the  area  that  he  is 
defending.  To  do  this,  he  must  be  able  to  quickly  evaluate  his  information 
about  the  enemy  and  about  his  own  combat  resources  and  decide  on  a  course  of 
action. 

Effective  decision-making  under  these  circumstances  will  depend 
upon  the  evaluator's  clear  voider  standing  of  the  relationship  between  the  available 
information  and  the  probability  of  success  of  each  course  of  action  open  to  him. 
Generally,  the  evaluator  should  select  that  tactic  that  has  the  highest  probability  of 
producing  success. 

Research  has  shown  that  people  are  severely  limited  in  their  infor¬ 
mation  processing  ability.  Decision  effectiveness  dramatically  decreases  when  a 
decision-maker  has  to  consider  information  about  a  number  of  parameters  before 
he  can  rationally  select  a  tactic.  However,  decision  performance  can  be  made 
more  effective  through  appropriate  training. 
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Preliminary  studies  at  AAI  have  shown  that  practice  in  a  situation 
where  feedback  is  in  the  form  of  the  decision-maker's  error  in  estimating  the 
probability  of  success  increases  decision  effectiveness.  After  practicing  in  such 
a  situation  a  decision-mciker  can  learn  to  maximize  his  probability  of  success. 

On  the  other  hand,  practicing  in  a  situation  where  feedback  concerning  the  ap¬ 
propriateness  of  a  decision  is  in  the  form  of  the  outcome  of  the  decision,  success 
or  failure,  does  not  increase  effectiveness.  In  fact,  decision  effectiveness  ap¬ 
pears  to  decrease  and  the  decision-maker  adopts  behavior  patterns  which  are 
analogous  to  superstitious  behavior. 

Since  the  inputs  to  the  decision-maker  ceui  be  controlled  in  a  training 
situation,  the  benefits  of  using  error  in  estimating  the  probability  of  success  for 
alternative  tactics  could  be  easily  obtained.  Once  the  evaluator  has  been  trained 
in  such  a  situation,  he  will  understand  the  relationships  between  his  tactical  in¬ 
formation  and  the  probability  of  success  of  his  decision  alternatives.  This  should 
permit  him  to  evaluate  his  tacticzd  information  faster  and  more  effectively  than 
he  would  be  able  to  when  he  is  trained  in  a  situation  where  the  ultimate  outcome 
of  his  decision  is  given  as  feedback. 

The  Human  Factors  Group  at  AAI  is  continuing  to  investigate 
variables  associated  with  training  decision-makers.  One  study  concerns  the 
determination  of  procedures  for  training  'people  to  formulate  the  alternative 
tactics  that  are  available  to  them.  There  is  some  anecdotal  evidence  that  sug¬ 
gests  that  people  make  decisions  without  firiit  considering  what  alternatives  are 
available  to  them. 

Another  area  of  interest  is  to  test  the  Progression  Hypothesis  in 
a  decision-making  situation.  The  basic  notion  here  is  that  if  a  trainee  could 
start  his  training  at  a  relatively  simple  level  and  progress  to  more  complex 
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levels  as  a  function  of  his  decision  effectiveness,  acquisition  of  decision-making 
skills  would  be  facilitated  more  than  if  he  were  to  start  at  a  complex  level. 

These  research  projects  are  in  their  early  stages  and  data  collection  has  not 
yet  begun.  However,  initial  computer  programs  have  been  written  and  pilot 
studies  will  be  inaugurated  soon. 
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TEAM  TRAINING  AS  A  FUNCTION  OF  TASK  ORGANIZATION,  TA^  COMPLEXITY, 
AND  SKILL  LEVEL  OF  SUBSTITUTE  TEAM  MEMBERS  ^ 

by 

James  C.  Naylor  and  George  E.  Briggs 
Ohio  State  University 


An  "operational"  task  was  defined  by  a  special-purpose  analog 
computer  which  required  a  three-man  team  to  observe  aircraft  returns 
on  a  simulated  radar  display  and  to  communicate  commands  to  eight  inter¬ 
ceptor  aircraft  as  targets  appeared  on  the  displays.  The  team  continued 
to  emit  commands  until  they  felt  a  successful  intercept  was  achieved} 
a  constant  load  of  eight  targets  was  maintained,  each  on  a  different 
but  constant  speed  and  heading  course.  The  pilots  were  members  of  the 
experimental  staff  vdio  implemented  commands  on  target  generators  and 
maintained  records  of  these  commands. 

Each  team  received  three  days  of  training  on  an  abstract  version  of 
the  operational  task  followed  by  four  days  on  the  operational  task  itself. 
On  the  third  day  of  operational  task  duty,  a  replacement  was  made  of  one 
of  the  team  men£)ers  and  the  replacement  was  either  more  experienced  or 
less  experienced  than  the  man  he  replaced.  Two  other  variables  were 
manipulated  systematically:  (!')  task  organization  occurred  at  two  levels, 
one  in  which  team  members  worked  independently  of  one  another  and  the 
other  in  idtlch  Interaction  between  team  members  was  encouraged}  and  (2) 
task  complexity  occurred  at  two  levels,  one  in  which  the  team  had  the 
relatively  difficult  Job  of  commanding  heading,  speed,  and  altitude 
changes  for  the  Interceptors  and  the  other  in  which  the  team  only  had 
to  issue  speed  and  heading  commands.  Four  teams  were  rtm  under  each  of 
the  eight  combinations  of  the  three  Independent  variables. 

The  results  in  terms  of  system  efficiency  are  summarized  in  Fig.  1 
for  the  "operational"  task  performance.  The  terms  2D  and  3D  refer  to 
the  task  difficulty  variable.  Figure  2  shows  the  results  for  another 
dependent  variable:  percent  successful  interceptions  which  were  defined 
as  vectoring  an  Interceptor  aircraft  to  within  two  nautical  miles  of  its 
target.  By  statistical  analyses  of  the  data  of  Pig.  1,  the  following 
conclusions  were  drawn: 

1;  There  were  no  significant  interactions  of  the  three  independent 
variables}  thus,  their  influence  on  team  performance  (see  below) 
was  quite  straightforward. 

2.  Task  complexity  was  a  very  potent  determinant  of  system  effi- 
ficiency  both  before,  during,  and  after  replacement  of  a  team 
member.  System  efficiency  was  higher  for  the  less  complex 
task. 
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3.  The  amount  of  training  of  the  replacement  operator  was  important 
only  at  the  time  of  replacement.  By  the  next  work  session  this 
was  not  a  significant  variable;  thus,  there  appears  to  be  only 
a  short-term  effect  of  this  variable  as,  apparently,  the  team 
adapts  to  the  new  operator's  skill  level  rather  quickly.  As 
expected  during  initial  replacement  the  more  experienced  re¬ 
placements  improved  system  efficiency  markedly  while  no  improve¬ 
ment  occurred  in  teams  which  received  a  less  skilled  man  as  re¬ 
placement. 

I4.  System  organization  did  not  influence  system  efficiency  until 
after  the  replacement  of  a  team  member  occurred;  then  it  af¬ 
fected  efficiency  for  two  work  sessions  (until  the  end  of  the 
experiment).  Thus,  system  organization  appears  to  be  a  benign 
variable  that  does  not  become  important  until  the  system  is 
stressed  (as  with  a  replacement),  but  once  "triggered"  it  has 
a  relatively  lasting  effect  on  team  performance  (unlike  re¬ 
placement  skill  level  which  had  only  a  short-term  effect). 

This  effect  was  one  of  greater  efficiency  for  teams  operating 
under  the  independent  than  under  the  interaction  system 
organization  condition. 


Footnote 


This  is  one  of  three  experiments  conducted  under  Contract  N61 339-1327 
between  the  U.  S.  Naval  Training  Device  Center  and  the  OSU  Research 
Foundation.  The  work  was  carried  out  in  the  OSU  Laboratory  of  Avia¬ 
tion  Psychology,  Dr.  G.  E.  Briggs,  Director.  Dr.  C.  K.  Bishop  served 
as  project  monitor  for  the  Navy. 
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Figure  1 

System  Efficiency  on  the  "Operational"  Task. 
Experiment  I,  Contract  N61339-1327 
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Figure  2 

System  Accuracy  on  the  "Operational"  Task. 
Experiment  I,  Contract  N61339-1327 
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INCREASING  TEAM  PROEICIENCY  THROUGH  TRAINING 

A  REVIEW  OF  THE  APPROACH  AND  FINDINGS 


1.  Approach  and  Methodology 

Robert  Glaser 
University  of  Pittsburgh 

Introduction 

I  should  like  to  describe  an  approach  to  the  experimental  study  of  the 
conditions  of  training  that  influence  the  acquisition  and  decay  of  group  performance , 

The  general  characteristics  of  the  type  of  analysis  to  be  considered  can 
be  illustrated  by  an  example.  Consider  a  two-man  team  in  which  a  "monitor" 
obtains  information  and  transmits  it  to  an  "operator"  who  processes  the  in¬ 
formation  and  transmits  the  team  output.  This  output  results  in  a  binary  con¬ 
tingency,  i.e.,  right  or  wrong,  a  hit  or  a  miss.  The  team  is  connected  in 
series  since  both  component  members  must  execute  a  correct  response  in 
order  for  the  team  to  produce  a  response  which  can  be  reinforced.  If  the 
performance  of  each  member  is  followed  only  by  reinforcement  for  the  team 
product,  then  several  predictions  can  be  made  as  to  the  likelihood  of  the 
occurrence  of  correct  responses  under  various  conditions.  When  both  men 
are  correct  the  team  response  will  be  reinforced  and  there  will  be  an  increase 
in  the  probability  of  correct  individual  responses.  When  both  men  are  in¬ 
correct  no  reinforcement  is  forthcoming  to  either  member  and  their  response 
probabilities  are  decreased.  When  one  member  responds  appropriately  and 
the  other  not,  the  subsequent  lack  of  reinforcement  results  in  an  extinction 
trial  for  the  member  responding  correctly.  In  such  a  team  situation  rein¬ 
forcing  events  which  are  contingent  upon  the  team  response  follow  the  pre¬ 
ceding  response  of  all  team  members  "indiscriminately,  "  i.  e.,  every  team 
member  is  exposed  to  the  same  event.  For  example,  in  the  above  series- 
linked-team,  when  one  member  responds  incorrectly  it  is  possible  for  no  posi¬ 
tive  feedback  to  occur  to  the  other  members  even  though  they  have  made  correct 
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responses.  This  "confounding"  characteristic  of  team  reinforcement  suggests 
one  way  of  defining  a  team  --a  group  of  individuals  who  are  all  reinforced  by 
a  single  event,  the  occurrence  of  which  depends  on  the  integrated  responding  of 
at  least  some  of  the  participating  members  on  any  one  trial,  A  central  concept 
is  that  group  feedback  is  contingent  upon  a  composite  of  individual  performance. 

The  initial  major  purpose  of  the  studies  we  shall  briefly  describe  is  to 
assess  the  feasibility  of  considering  the  team  as  a  learning  unit  which  reacts 
to  the  presence  or  absence  of  reinforcement  following  a  response  in  a  way 
similar  to  the  response  of  individuals  as  observed  in  a  learning  laboratory. 
Accordingly,  when  taken  as  a  response  unit,  the  team  product  should  exhibit 
increments  or  decrements  as  a  function  of  the  properties  of  the  stimulus  con¬ 
tingencies  following  each  trial.  For  example,  the  team  should  acquire  pro¬ 
ficiency  in  responding  when  feedback  to  the  team  is  reinforcing,  and  once 
acquired,  extinction  of  the  team  response  should  occur  if  reinforcing  feed¬ 
back  is  withheld.  Study  One  was  designed  to  test  this  hypothesis  and  to 
determine  the  influence  of  the  presence  and  absence  of  group  reinforcement 
on  the  performance  of  a  series  team  as  a  unit.  Study  Two  considered  the  more 
complic'ted  case  of  a  team  linked  in  "parallel."  In  a  parallel  team  a  correct 
response  by  either  one  or  more  members  can  produce  a  correct  team  response; 
here  the  reinforcing  contingencies  are  complicated  by  the  fact  that  a  team  rein¬ 
forcement  can  follow  a  member's  performance  when  he  makes  an  incorrect 
response. 

Methodological  Perspective 


In' studying  the  performance  of  a  team,  one  level  of  analysis  is  to 
observe  the  team  as  a  responding  entity.  From  this  point  of  view,  one  looks 
at  the  stimuli  that  impinge  upon  the  group  and  observes  the  properties  of  the 
group  responses  that  occur.  It  is  as  if  the  group  is  considered  as  an  "empty 
organism"  or  a  b’  -k  box  and  input-output  relationships  are  being  observed 
for  study  without  going  into  the  black  box.  The  study  of  team  performance 
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on  the  level  of  group  input  and  group  response  can  be  called  "naolar"  in  the 
sense  that  the  response  class  under  consideration  is  a  group  product  and  not 
the  responses  of  the  individual  group  members.  When  a  single  organism  is 
the  object  of  study,  depending  upon  the  intent  of  the  investigator,  observations 
also  may  be  made  of  molar  events,  e.g. ,  reaction  time  as  a  function  of  number 
of  stimulus  choices,  or  concomitant  "molecular"  events,  e.g,,  concurrent 
muscular  action  potentials.  In  an  analogous  manner,  from  a  molar  point  of 
view,  group  response  can  be  studied  as  a  function  of  environmental  contin¬ 
gencies  without  going  "beneath  the  skin"  of  the  group  to  the  observation  of  the 
individual  members.  It  is  also  possible,  from  a  molecular  point  of  view,  to 
look  at  the  responses  of  individual  members  as  they  are  Influenced  by  the  team 
environment. 

Possible  relationships  that  can  be  studied  on  each  level  of  investiga¬ 
tion  and  across  levels  are  illustrated  in  Figure  1 .  The  diagram  shows  two 
three -man  teams.  In  Team  A,  information  is  passed  along  a  single  line,  as 
indicated  by  the  directional  arrows,  in  the  same  way  as  a  simple  series  cir¬ 
cuit.  Team  B  is  also  connected  in  series  --  each  man  must  perform  correctly 
to  complete  the  team  task  —  but  in  this  case,  two  team  members’  responses 
serve  as  the  stimulus  inputs  to  a  third  member.  In  Figure  1,  the  capital  letters 
refer  to  group  stimuli  and  group  responses.  The  small  letters  refer  to  stimuli 
and  responses  with  respect  to  the  individual  group  members.  In  Team  A,  S 
refers  to  the  stimulus  event  which  initiates  group  activity.  S  can  be  considered 
as  an  external  stimulus,  i.e.,  coming  from  outside  the  group's  immediate  en¬ 
vironment.  R  is  the  group  response  which  is  a  function  of  whatever  transforma¬ 
tions  have  occurred  by  the  group  members  "beneath  the  skin"  of  the  team. 

is  the  environmental  consequence  that  is  brought  about  as  a  result  of  the  team 
response.  acts  as  group  feedback  when  it  is  an  observable  event  following 
the  group  response.  The  circles  in  Figure  1  refer  to  individual  team  members 

and  s  ,  refers  to  the  stimulus  input  for  team  member  1,  r,  is  his  response,  and 

f  ^  ^ 

s  j  the  feedback  to  him  or  consequence  of  his  response. 
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f  f 

S  and  s  may  be  different  events  depending  upon  the  man-machine  team 
arrangement,  the  remoteness  of  the  individual  team  member  from  the  occur- 

f 

rence  of  S  ,  and  also  his  opportunity  to  observe  it.  The  notations  in  Team  B 

have  the  same  meaning  as  has  been  described,  except  that  S  and  S.  refer  to 

&  D 

the  fact  that  two  environmental  inputs  are  fed  into  this  team.  (S  and  s.  and 

St  1 

S,  and  s  may  or  may  not  be  similar  events  depending  upon  the  nature  of  the 
D  a 

team  task  and  the  construction  of  the  communication  arrangement.) 

Legitimate  variables  for  study  are  any  of  the  stimuli  and  response 

relationships  in  Figure  1,  for  example:  the  relationship  between  group  input 

f 

S,  group  response  R,  and  group  feedback  S  ;  team  member  response,  r.,  r„, 

f  1  ^ 

. .  .  r  ,  as  a  function  of  group  feedback  S  ;  the  relationship  between  feedback 
n  j 

to  the  individual  s  and  group  response  R;  the  relationship  between  individual 

f 

feedbacks  and  individual  response  r^,  rg,  ....r^.  As  has  been  indicated  the 
relationship  between  the  team  member  response  and  group  feedback  is  especially 
interesting  in  situations  where  the  feedback  to  individuals  is  not  the  consequence 
of  their  own  response,  but  rather  the  consequence  of  their  response  as  con¬ 
founded  with  the  responses  of  other  group  members.  Intensive  investigation  of 
these  varieties  of  relationships  should  contribute  to  the  detailed  experimental 
analysis  of  team  training  and  team  performance.  The  studies  I  should  like  to 
mention  illustrate  primarily  molar  investigations  of  team  performance  and  team 

learning.  Of  particular  interest  is  the  relationship  between  group  responses  R 
f  f 

and  group  feedback  S  ,  when  S  is  considered  as  a  reinfoi'cing  stimulus.  In  these 
studies  the  data  of  primary  concern  are  observable  team  output  and  team  feed¬ 
back  events  that  occur  outside  the  boxes  in  Figure  1,  and  the  determination  of 
orderly  functional  relationships  between  these  events.  The  investigation  stays 
on  a  molar  level  but  looks  into  the  "team  box"  for  explanatory  variables  based 
upon  individual  performance.  The  general  question  being  asked  is:  To  what 
extent  are  molar  relationships  of  team  learning  similar  to  the  functional  re¬ 
lationships  in  learning  that  have  been  identified  in  studies  of  individual  or 
single  organism  learning;  and  to  what  extent  does  such  an  approach  provide  a 
basis  for  the  further  analysis  of  team  behavior  and  the  problems  of  increasing 
team  proficiency  through  training? 
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Figures  2  and  3  show  the  general  layout  of  the  laboratory  and  subject's 
panel.  Table  1  briefly  describes  the  training  phases  and  criteria  for  Study  One. 
Figure  4  illustrates  the  three-man  series  team  used  in  Study  One.  Figures  5 
through  11  show  representative  findings  from  Study  One. 

Figures  12,  13  and  14  illustrate  the  team  arrangements  used  in 
Study  Two.  Table  2  lists  the  training  phases  and  sequence  followed  in  Study 
Two.  Figures  15  through  20  show  representative  findings  obtained  in  Study  Two. 


D-12 


oo 

nn 


D-14 


Table  1 


Training  Phase 
Individual 

Pattern 

Three-man  team 


Description  and  Criteria  of  the  Training  Phases 


Description 

Subjects  practiced  making 
ttra-  and  four-second  time 
estimations . 

Monitors  practiced  timing 
responses  to  different 
light  patterns. 

a)  Ten-minutes  of  warm-up 
of  the  tvra-  and  four-second 
presses  daily. 

B)  All  three  subjects ’ 
performance  combined  in 
a  joint  effort  to  secure 
the  team  product. 


Criterion 

Four  consecutive  five- 
minute  periods  of  63  per 
cent  or  better. 

None 


None 


1)  Acquisition:  four 
consecutive  five-minute 
periods  of  ten  or  more 
group  points. 

2)  Extinction:  four 
consecutive  five-minute 
periods  of  zero  group 
points . 

3)  Spontaneous  Recovery: 
two  consecutive  five- 
minute  periods  of  zero 
group  points. 

4)  Re-acquisition:  (same 
as  acquisition) . 

5)  Re -extinct ion:  (same 
as  extinction) . 
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FTgur«  4;  Schematic  of  a  three-«itan  serf 


Figure  5;  CompTlson  of  aegulsttion  curves:  Individual  and  Team  Training 
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Table  2 


Phases,  Titles,  DescriptlonB,  and  Criteria  of  Training 


Phase  Title 

A  Preliminary 

Orientation 


B  Individual 
Training 


C  Pattern 
Training 


D  TVo-Man 
Team 
Training 


E  Redundancy 
Team 
Training 


Description  Criterion 

Introduction  to  Laboratory,  None 
signing  of  dally  time 
sheets,  assignment  to  panels, 
descriptive  instructions 
about  apparatus,  etc. 


Subjects  practiced  individually 
learning  to  make  accurate 
two-second  and  four-second 
presses 


Four  consecutive 
five-minute 
periods  of  .63 
(ratio  of  correct 
to  total  presses) 
proficiency  for 
all  individuals 


Monitor  one  and  monitor  two 
practiced  making  appropriate 
two-second  and  four -second 
presses  to  four  different 
light  patterns,  for  ten 
minutes  (about  35  patterns) 

Monitor  one  &  operator,  and 
monitor  two  Sc  operator,  of 
each  team  practiced  as  two- 
man  components 


None 


Four  consecutive 
five -minute 
periods  of  15  or 
more  team  points 
for  every  two-man 
team 


Hie  three  members  of  each 
team  worked  in  a  conjoint 
effort  to  score  points 


Four  consecutive 
five -minute 
periods  of  ten  or 
fewer  team  points 
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Figure:  15  Team  I:  Two-man  component  and  redundancy  team  proficiencies 


Figure:  16  Team  2:  Two-man  component  and  redundancy  team  proficiencies 
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Figure:  17  Team  3-  Two-man  component  and  redundancy  team  proficiencies 
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Figure:  20  Team  6;  Two-man  component  and  redundancy  team  proficiencies 


Part  II:  Experimental  Findings 
David  J .  Klaus 

American  Institute  of  Research 

As  has  just  been  described,  we  found  we  were  able  to  study  team 
performance  in  the  Team  Training  Laboratory  when  the  team  was  regarded 
as  the  module  of  investigation.  Both  reinforcement,  or  its  absence, 
and  the  basic  structure  of  the  team  were  found  to  affect  the  acquisition, 
maintenance,  and  extinction  of  a  team  response.  This  represented  the 
first  phase  of  our  research,  determining  the  extent  to  which  team  per¬ 
formance  in  the  laboratory  could  be  observed  and  manipulated.  Since 
then,  a  second  phase  of  the  research  has  been  undertaken  and  a  third 
phase  has  been  initiated  on  a  pilot  basis.  The  experimental  findings 
obtained  from  these  studies  suggest  a  number  of  variables  which  might 
be  considered  in  future  work  on  team  performance. 

The  second  phase  of  the  research  consists  of  efforts  to  control 
the  outcomes  of  team  training  by  further  analyzing  and  varying  struc¬ 
tural,  individual  member,  and  procedural  factors  which  might  affect 
team  performance.  Thus  far,  three  studies  have  been  initiated  for  this 
purpose.  The  first  of  these  was  conducted  by  Karl  Egerman  as  his  doctoral 
dissertation.  The  purpose  of  the  study  was  to  investigate  the  relationship 
betweeh  team  structure  and  the  course  of  individual  member  performance 
as  it  was  affected  by  the  appropriateness  or  inappropriateness  of  team 
reinforcement  during  team  training.  From  the  description  of  the  team  para¬ 
digm  already  given,  it  should  be  clear  that  whether  or  not  a  team 
member  experiences  reinforcement,  either  appropriate  or  not  appropriate, 
depends  upon  the  performance  of  the  other  members  of  the  team  and  upon 
the  conditions  under  which  team  reinforcement  will  be  supplied.  Thus,  the 
schedule  of  reinforcement  experienced  by  each  team  member  for  both 
correct  and  incorrect  responses  is  a  function  of  the  contribution  of  Ms 
responses  to  team  success  and  the  relationship  between  team  success  and 
the  response  he  made  on  that  trial. 
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In  this  study,  three  types  of  teams  were  investigated.  Each  team 
was  composed  of  two  members  who  were  given  a  constant  amount  of  pre- 
training  on  the  timing  response  before  being  assembled  into  teams.  The 
first  type  of  team  was  the  series  team;  in  a  series  team,  both  members 
had  to  be  correct  for  a  team  reinforcement  to  follow.  Under  these  circum¬ 
stances,  each  team  member  experienced  reinforcement  for  only  some  of  his 
correct  responses  but  he  never  experienced  reinforcement  for  any  of  his 
incorrect  responses.  For  a  member  of  a  series  team,  then,  appropriate 
reinforcement  is  aperiodic  and  non -appropriate  reinforcement  does  not 
occur.  The  second  type  of  team  was  the  parallel  team;  in  a  parallel  team, 
only  one  member  has  to  be  correct  for  a  team  reinforcement  to  follow. 

Under  these  circumstances,  each  team  member  experienced  reinforcement 
for  all  of  his  correct  responses  but  he  also  experienced  occasional  reinforce¬ 
ment  for  some  of  his  incorrect  responses.  For  a  member  of  a  parallel 
team,  then,  appropriate  reinforcement  is  continuous  and  non -appropriate 
reinforcement  is  aperiodic.  The  third  type  of  team  was  the  individual  team; 
in  an  individual  team,  the  occurrence  of  a  team  reinforcement  depends  solely 
upon  the  performance  of  one  member,  while  the  performance  of  the  other 
member  is  not  considered.  Under  these  circumstances,  the  "team"  member 
experiences  appropriate  reinforcement  for  both  his  correct  and  incorrect 
responses,  while  the  "non -team"  member  experiences  aperiodic  reinforce¬ 
ment  both  for  his  correct  and  incorrect  responses. 

Several  predictions  can  be  made  concerning  team  and  individual 
member  performance  under  these  various  conditions.  First,  knowing  the 
hypothetical  probability  of  a  correct  team  response  in  each  of  these  three 
arrangements  and  knowing  the  proficiency  of  the  individual  members  prior 
to  entering  team  training,  it  should  be  possible  to  predict  the  proportion  of 
correct  team  responses  during  the  initial  stages  of  team  training.  This  is 
illustrated  in  Figure  21.  Second,  it  should  be  possible  to  predict  the  rela¬ 
tive  number  of  correct  responses  made  by  each  member  during  the  course 
of  training  based  upon  a  knowledge  of  his  predicted  schedule  of  reinforcement; 
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e.g.,  continuous  appropriate  reinforcement  is  the  most  favorable  schedule, 
as  further  refined  by  a  knowledge  of  individual  pre-team  member  proficiencies. 
Finally,  it  should  be  possible  to  predict  the  course  of  team  proficiency  over 
a  period  of  team  performance  on  the  basis  of  knowing  the  reinforcement 
schedules  experienced  by  the  members  of  a  particular  type  of  team. 

Six  teams  of  each  type,  series,  parallel,  and  individual,  were  studied 
for  130  five-minute  periods  spaced  over  several  days  using  an  experimental 
procedure  similar  to  those  already  described.  The  findings  of  the  study  were, 
first,  initial  team  performance  and  performance  predicted  from  arrange  - 
ment  and  member  proficiencies  correlated  .73;  second,  the  ranked  perfor¬ 
mance  of  team  members  correlated  .  94  with  ranks  predicted  on  the  basis 
of  member  proficiencies  prior  to  team  training  and  arrangement-influenced 
schedules  of  reinforcement;  third,  the  Influence  of  different  schedules  of 
reinforcement  on  the  course  of  team  performance  is  shown  in  Figure  22 
which  describes  the  drop  in  performance  attributable  to  inappropriate  rein¬ 
forcement  for  incorrect  responding. 

Some  typical  performance  curves  obtained  from  each  of  the  three 
types  of  teams  are  shown  in  Figures  23  -  25  on  the  following  pages.  Notice 
that  team  proficiency  is  necessarily  less  then  individual  proficiency  in  the 
series  teams,  necessarily  greater  in  the  parallel  teams,  and  equal  to  the 
"team"  member  curve  for  the  individual  teams.  Notice,  also,  the  tendency 
for  the  performance  curve  of  parallel  teams  to  show  a  decrease  in  proficiency 
with  time  and  the  tendency  for  one  member  to  extinguish.  In  two  of  the 
individual  teams,  the  "non-team"  member  managed  to  maintain  proficient 
performance  throughout  the  experiment  despite  completely  inappropriate 
reinforcement.  This  was  felt  to  be  due  to  the  high  level  of  entering  pro- 
ficieiicy  for  these  members. 

The  next  study  undertaken  was  an  attempt  to  define  some  of  the 
parameters  of  individual  member  characteristics  and  training  conditions 
which  might  influence  the  acquisition  and  extinction  of  a  team  response, 
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As  shown  in  Figure  26,  28  three  man  series  teams  were  studied  in  a  multi¬ 
variate  design  which  simultaneously  investigated  entering  member  proficiency 
(high,  medium,  and  low),  member  ability  (fast  learners  and  slow  learners), 
draining  delays  (immediate  or  delayed  initiation  of  team  training),  and  team 
structure  (members  apart  or  together  in  proficiency).  All  teams  were  under 
continuous  reinforcement  during  acquisition  and  then  were  placed  on  extinction 
after  meeting  a  uniform  proficiency  criterion. 

Seven  of  the  28  teams  failed  to  reach  the  acquisition  criterion  after 
300  five -minute  periods.  Most  of  these  were  lov/  teams,  where  the  probability 
of  a  correct  team  response,  computed  on  the  basis  of  entering  member 
proficiency,  was  so  low  that  an  "extinction  ratio"  was  in  effect;  i.e.,  ex 
tinction  occurred  in  spite  of  occasional  reinforcement  because  there  was 
not  a  sufficient  number  of  reinforcements  to  maintain  the  response.  The 
probabilities  of  a  correct  team  response,  in  terms  of  the  parameters  studied, 
are  shown  in  Figure  27.  Trials  to  acquisition  are  shown  in  Figure  28,  and 
trails  to  extinction  are  shown  in  Figure  29  following.  The  low  teams  re¬ 
quired  more  trials  to  reach  criterion  and  more  trials  for  extinction  to 
occur.  Figure  30  shows  the  number  of  trials  required  for  the  first  100 
correct  responses.  This  is,  perhaps,  a  more  sensitive  measure  of  team 
learning  than  the  acquisition  of  a  performance  criterion. 

From  the  evidence  obtained,  two  factors  seem  to  influence  team 
performance.  First,  individual  member  proficiency,  or  level  of  attain¬ 
ment,  is  an  important  determiner  of  team  learning;  acquisition  is  sub¬ 
stantially  more  rapid  in  teams  composed  of  high  proficiency  members, 
as  would  be  expected,  on  the  basis  of  the  probability  of  a  correct  team  response. 
Second,  teams  composed  of  slow  learners  tend  to  have  more  rapid  acquisi¬ 
tion,  especially  early  in  team  training,  than  teams  composed  of  fast  learners. 
This  is  probably  due  to  the  experience  they  have  had  with  intermittent  rein¬ 
forcement.  We  have  detected  a  dip  in  team  performance  early  in  the  training 
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pf  series  teams  which  reflects  a  switch  in  the  ratio  of  reinfo rcexnent  ex¬ 
perienced  by  the  team  members.  Some  experience  with  low  or  intermittent 
schedules  during  individual  training  seems  to  facilitate  later  team  training. 
Perhaps  the  football  coach  is  correct  after  all;  with  ample  practice,  slow 
learners  are  likely  to  result  in  a  highly  proficient  team. 

The  third  study,  which  is  now  in  progress,  is  an  attempt  to  accelerate 
team  acquisition  by  the  use  of  a  simulated  supervisor  early  in  team  training. 
In  our  early  analysis  of  team  learning,  we  hypothesized  that  the  role  of  a 
supervisor  was  that  of  supplying  reinforcement  to  individual  team  members 
which  was  independent  of  the  success  or  failure  of  the  team  as  a  whole.  In 
other  words,  this  was  the  "pat-on-the-back"  needed  to  maintain  individual 
proficiency  during  periods  when  the  team  was  not  successful  enough  to 
produce  sufficiently  frequent  reinforcements.  As  was  just  noted,  this  is 
especially  likely  early  in  team  training  and  with  teams  composed  of  members 
at  low  levels  of  entering  proficiency. 

In  this  study,  18  three-man  series  teams  are  being  trained;  six  teams 
are  composed  of  low  proficiency  members,  six  of  medium  proficiency  mem¬ 
bers,  and  six  of  high  proficiency  members.  Three  of  the  teams  in  each  pro¬ 
ficiency  group  are  being  trained  as  in  previous  studies.  The  remaining  teams 
are  required  to  reach  acquisition  criterion  twice;  first,  with  individual  rein¬ 
forcement  supplied  to  each  team  member  on  the  basis  of  the  correctness  of 
his  response  in  addition  to  the  team  reinforcement  supplied  to  the  team  as  a 
whole  for  a  correct  team  response;  and  a  second  time,  without  individual 
reinforcement.  We  predicted  that  the  experimental  teams  would  reach  the 
team  performance  criterion  faster  than  the  control  teams,  even  though  they 
had  to  reach  it  twice,  and  that  the  effect  would  be  more  pronounced  for  low 
teams  than  for  high  teams. 

Nine  of  the  18  teams  have  been  completed  and  three  others  are  cur¬ 
rently  in  progress.  Thus,  the  findings  are  quite  tentative  but  well  worth 
repeating  because  they  point  out  the  surprise  factor  in  team  research.  The 
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experimental  team,  do  not  seem  to  be  attaining  final  criterion  any  more 
rapidly  than  control  teams,  regardless  of  the  proficiency  of  the  members. 

On  the  other  hand,  the  experimental  teams  seem  to  develop  a  substantially 
greater  resistance  to  extinction  than  the  control  teams  and  this  is  more 
pronounced  in  teams  with  high- proficiency  members  than  in  teams  with  low- 
proficiency  members.  We  intend  to  delay  suggesting  explanations  for  these 
results  until  we  learn  whether  or  not  the  data  from  the  remaining  teams  in 
the  study  substantiate  these  tentative  findings. 

The  third  phase  of  research  in  the  Team  Training  Laboratory  has 
been  the  study  of  simulated  teams,  where  one  individual  is  subjected  to  the 
conditions  he  would  experience  had  he  been  a  member  of  a  team.  As  more 
and  more  is  learned  about  the  factors  influencing  team  performance,  it 
should  be  possible  to  test  a  number  of  important  hypotheses  relating  to  the 
effects  of  a  team  environment  on  individual  performance  and,  in  turn,  the 
effects  of  changes  in  individual  proficiency  on  team  output.  Only  one  investi¬ 
gation  has  been  conducted  thus  far  using  simulated  teams.  This  was  a 
pilot  study  designed  by  Jerry  Short. 

The  hypothesis  investigated  in  this  study  is  illustrated  in  Figure  31. 
Using  the  theorem  of  probability  applicable  to  series  team  performance,  it 
is  possible  to  calculate  that  only  on  60%  of  the  instances  when  man  A  in  a 
two-man  team  is  correct  will  the  team  be  reinforced;  in  other  words,  man  A 
will  experience  reinforcement  only  for  60%  of  his  correct  responses  in  a 
two-man  team.  In  a  five-man  team,  man  A  will  be  reinforced  only  for  13% 
of  his  correct  responses.  In  the  study,  nine  individuals  were  trained  until 
their  pre-team  proficiency  stabilized.  They  were  then  switched  to  a  simu¬ 
lated  team  condition  in  which  their  correct  responses  were  reinforced 
according  to  a  hypothetical  schedule  computed  on  the  basis  of  the  number  of 
members  in  the  imilated  team.  Figure  32  shows  the  result.  For  either 
type  of  team,  the  difference  in  proficiency  between  the  end  of  individual 
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and  the  beginning  of  team  training  is  significant.  Also,  on  the  average,  re¬ 
covery  of  pre-team  proficiency  was  more  likely  in  the  two -man  than  five- 
man  teams  so  that  there  was  a  significant  difference  in  the  over -all  pro¬ 
ficiency  of  members  of  the  two-  and  five -man  teams. 

In  summary,  the  study  of  teams  as  the  modules  of  investigation  and 
reinforcement  contingencies  have  both  proven  to  be  fundamentally  sound 
approaches  in  a  series  of  laboratory  investigations.  Several  findings  have 
been  obtained,  such  as  those  on  team-member  redundancy,  team  composition, 
and  the  difficulty  in  switching  from  individual  to  team  training  conditions, 
which  could  be  applied  to  non-laboratory  teams  for  verification.  Even  more 
important,  it  has  been  possible  to  define  a  team  in  such  a  way  as  to  develop 
a  conceptual  framework  which  has  considerable  promise  for  the  further  in¬ 
vestigation  of  the  performance  of  multi-man  systems. 


0-43 


VI 

lU 

U 


O  uj 


VI 

ui 


KJ 

iZ 

o 

a£ 

a. 

z 

< 


O 

< 

0£ 

UI 

> 

< 


Z  ^ 

Z  2 

E  UJ 
<  UI 

5  O 

u  Z 

o 

U.  fi£ 

z  < 

ui  ^ 
a:  < 

u.  < 

O  IS 

UJ 

2  => 
w  S 
I  > 

-I 

UI  js 

-i 

o  < 


< 

z 


z  5 

-  2  < 
Ik  UI  Oi 

z .^  "■ 

<  »«  4A 

-•9  s 

<  Z  S 

p:  <  VI 

Z 


c 

<1> 

E 

0>  3 

i2  -c 
c  ^ 
.=  to 
a> 

OS 


a> 

o 

c 

CD 

I 


0>  lO 

c  0> 

£  g 

u  5 

s. 

•i:  i/> 

s  ^ 

a>  ^ 
a:  tS 
o  g> 

■■5  k- 
o  o 
C  O 

S  •- 
c  S 


a> 

0£ 

•*J"  +-> 

fc.  k. 
w  w 
o  o 

</»  £ 

g-8  S 

•«-»  w  c 

<=  S  s 
o  o-  S. 

O  ^ 


8 

nf 

T 


q: 


o 

o 


t/t 

3 

o 

3  I/I 
C  «> 
•3  </> 

n! 

O  g. 

O  ^ 


R 

CVI 


« s? 
t  }2 
o  5 

«  a 

£  « 
o  Od 
CO  ^ 

.  o 

*»  a> 

«S  t 

O  O 

‘■o  y 
.2  .3 
fe  TS 

Q.  C 
<(  Rl 


IT' 


V*  S 


»-  TO 

I?  •= 
Q.„ 

S 

S 

.5  c 

li£ 

ITS 


8 


8 

3 


8 

od 


s  s 


» • 

W 

0) 

3) 

S 


D-45 


KEY 


D-47 


Figure  24:  Two  sample  parallel  teams  (Teams  3  and  k) 


Study  III:  Design 
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Figure  27;  Protahillty  of  tt—  reiiiforewwnt  Ip  Parmeter  Study. 
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Figure  28;  FlTe^mlnate  trials  to  aequlgltien  In  Paraaeter 
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Figure  29:  yive«)iii>ttte  trl«li  to  *Kttnetton  In  Parweter  Study. 
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|<’Lgure  30;  trials  to  100  correct  rasponsea  In  Parameter  Study. 
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Study  VI  (B) 


Figure  31:  ProbaMllty  of  reinforcement  for  correct  responses  in  simulated  , 
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Preface 


For  a  number  of  years,  we  have  had  opportunities  to  examine  the 
Navy's  personnel  readiness  situation  from  several  points  of  view.  These 
opportunities  have  ranged  from  extensive  shipboard  observations  to  formal 
scientific  analyses.  As  a  consequence,  and  more  or  less  unexpectedly,  a 
concept  has  suggested  itself  as  a  new  approach  to  chronic  personnel  readi¬ 
ness  problems .  The  basic  notion  occurred  over  eight  years  ago,  while  the 
authors  were  involved  in  an  analysis  of  future  anti-air  warfare  personnel 
problems.  It  has  been  very  persistent.  Despite  clearly  foreseeable  obstacles 
to  implementation,  the  concept  lingers  on.  In  an  effort  to  arrive  at  a  conclu¬ 
sion  about  its  validity,  and  at  the  same  time  to  describe  it  to  those  in  the  Navy 
who  may  be  interested,  the  following  material  has  been  prepared. 

It  is  hoped  that  you  will  consider  it  fairly  and  will  react  to  it 
honestly.  We  are  particularly  interested  in  learning  about  parts  of  it  that 
you  have  difficulty  in  understanding.  Also,  since  this  is  an  effort  to  exhaust 
possible  functions  which  might  be  assigned  to  a  vehicle  designed  to  implement 
the  concept,  we  welcome  additions  to  the  list. 


I.  PERSONNEL  READINESS  PROBLEMS 


Although  fleet  tactical  capabilities  have  been  strengthened  by 
new  weapon  systems,  the  readiness  to  employ  these  systems,  as  well  as 
to  maintain  them,  continues  to  be  a  matter  of  concern.  In  these  areas, 
many  factors  limit  the  effectiveness  of  man-machine  combinations  to 
operate  and  to  maintain  new  weapon  systems,  with  the  result  that  the 
operational  capabilities  of  these  systems  fall  far  short  of  expecta¬ 
tions.  Shortcomings  of  the  existing  systems  are  well  known.  Several 
of  the  frequent  complaints  stem  from  the  following  factors. 

I .  First-Enlistment  Technicians. 

This  has  been  a  chronic  problem  since  at  least  the  days  of  World 
War  II.  Although  there  may  have  been  brief  intervals  since  then  when 
the  supply  of  highly  proficient  technicians  was  adequate,  the  general 
trend  has  been  one  of  short  supply.  In  view  of  this,  the  obvious  as¬ 
sumption  to  make  Is  that  the  U. S.  Navy  will  have  to  depend  upon  the 
first-enlistment  technician  for  operating  and  maintaining  Its  equipment 
into  the  foreseeable  future.  The  constraints  which  this  condition  places 
upon  the  training  and  utilization  of  personnel  are  well  known. 

2*  Wild  Fluctuations  in  Crew  Proficiency. 

The  deployment  cycle  of  ships  is  accompanied  by  a  personnel  cycle 
in  which  the  crew  of  any  one  ship  varies  from  reasonably  experienced  and 
proficient  to  "green”  men  who  have  had  little  or  no  shipboard  experience 
and  whose  training  may  be  quite  sketchy.  Ships  returning  from  theatres 
of  operation  frequently  lose  a  high  proportion  of  their  experienced 
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personnel,  to  be' replaced  by  these  new  men.  Although  the  readiness 
requirements  for  the  ship  may  remain  roughly  uniform,  the  personnel 
resources  to  meet  them  do  not.  In  a  recent  example,  a  CVA  about  to  be 
deployed  to  WESTPAC  had  only  one  ET-2  aboard.  This  individual  was 
required  to  act  as  the  lead  for  the  remaining  thirty  or  so  technicians,  ail 
of  whom  were  ET-3's  or  ETSN*s.  When  the  carrier  returns,  a  fairly  large 
proportion  of  these  men,  who  by  now  will  be  relatively  experienced,  will 
be  lost  to  shore  schools,  re-assignment,  or  completion  of  enlistment. 

3.  Wide  Variation  in  Individual  Proficiency 

At  any  one  time,  a  ship  commander  is  apt  to  find  himself  with  a 
heterogeneous  mixture  of  experienced  and  inexperienced,  trained  and  un¬ 
trained,  career  and  non-career  personnel.  This  comes  about  through 
"normal"  personnel  attrition.  This  cross-sectional  variation  reduces 
the  overall  average  proficiency.  It  results  in  heterogeneous  teams 
whose  efficiency  is  limited  by  the  least  experienced  members.  It  presents 
problems  for  shipboard  training,  since  many  different  levels  of  training 
are  required.  It  places  an  extra  burden  on  the  more  experienced  personnel 
for  training  and  supervision  of  the  green  men. 

4.  Haphazard  Shipboard  Training 

Although  individuals  accumulate  experience  In  the  operational  environ¬ 
ment,  it  is  doubtful  if  that  experience,  haphazard  as  it  often  is, 
represents  the  most  effective  way  to  bring  skills  up  to  satisfactory  levels. 
Effective  learning  situations  require  careful  pre-arrangement  and  are 
characterized  by  features,  such  as  reinforcement,  which  may  be  quite 
rare  in  operational  situations.  Many  combatant  vessels,  particularly 
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the  smaller  ones',  lack  adequate  facilities  for  conducting  formal  ship¬ 
board  training.  Personnel  are  already  very  busy  with  other  duties,  and 
may  not  be  adequately  trained  to  serve  as  instructors.  Classroom  spaces 
are  hard  to  find.  Audio-visual  aids,  text  books,  and  the  other  require¬ 
ments  for  efficient  training  may  be  lacking.  For  these  reasons,  for 
many  of  the  personnel  manning  a  ship,  important  aspects  of  their  train¬ 
ing  stop  at  the  water's  edge. 

5*  Unwieldiv  Team  Training  Exercises 

Training  situations  which  are  designed  to  exercise  groups  of  men, 
from  small  teams  aboard  a  single  ship  to  task  group  and  task  force  size, 
become  progressively  more  unwieldly  and  expensive  as  the  size  of  the 
group  increases.  The  large  fleet  exercises  at  sea,  which  are  recognized 
as  indispensable  dress  rehersals,  are  extremely  difficult  to  implement 
to  ensure  that  worthwhile  benefits  are  obtained.  There  are  unsolved 
problems  of  scoring,  evaluating,  and  diagnosing  personnel  actions.  Conse¬ 
quently,  accurate  Information  is  unavailable  about  changes.  If  any,  in 
personnel  performance.  The  complexities  of  the  plans,  the  organization, 
and  the  scheduling  involved  in  these  large  exercises,  and  the  expense  in¬ 
volved  in  running  them  off,  makes  it  especially  important  that  the  maximum 
amount  of  training  results  from  them. 

6,  Uncoordinated  Operations  and  Personnel  Subsystems 

The  operational  commitments  of  a  ship,  or  of  the  force  to  which  it 
belongs,  oftentimes  are  at  variance  with  the  methods  and  objectives  of 
personnel  readiness.  It  may  not  be  possible  for  a  ship  commander  to 
spare  key  personnel  for  shorebased  schools.  He  may  not  be  able  to  give 
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the  most  poorly  -trained  members  of  his  crew  opportunities  to  learn  in 
those  situations  in  which  their  eerors  might  have  serious  consequences 
for  the  safety  of  or  for  the  evaluation  of  the  ship  as  a  whole. 

in  his  position  at  the  end  of  the  "personnel  ptpiine",  the  ship 
commander  is.  In  one  sense,  required  to  take  what  comes  out  of  the 
pipeline.  He  is  in  a  position  of  having  to  do  the  best  he  can  with  what 
is  given  to  him.  Under  these  circumstances,  it  is  not  surprising  that 
personnel  readiness  Is  the  major  limiting  factor  In  ship  and  force  readiness, 

7»  Technical i v  Sophisticated  Weapon  Systems 

It  is  common  knowledge  that  weapon  systems  in  the  fleet  today  are, 
by  all  criteria,  more  sophisticated  than  those  which  were  in  use  at  the 
end  of  World  War  II.  Technological  advances  in  ail  the  areas  which 
support  and  produce  the  systems  are  well  known.  There  is  no  need  to 
belabor  the  point;  this  has  imposed  greater  demand  for  technical  train¬ 
ing  of  the  personnel  who  are  expected  to  operate  and  to  maintain  these 
systems. 


II.  THE  CONCEPT  OF  A  PERSONNEL  SUPPORT  SHIP 


The  concept  that  Is  proposed  here  is  that  of  a  personnel  support 
ship  analogous  in  some  respects,  but  only  in  some  respects,  to  hardware 
tenders.  The  personnel  support  ship  would  perform  its  most  important 
functions  in  ways  that  are  not  characteristic  of  an  ordinary  tender. 

1.  Seagoing  Support 

A  variety  of  training  functions,  extending  from  the  individual  to 
the  fleet  level,  would  be  performed  by  the  personnel  support  ship  while 
it  accompanied  other  ships  at  sea.  This  would  not  necessarily  be  confined 
to  large  units  on  tactical  missions.  It  is  recognized  that  tne  tactical 
uiiiizacion  of  combatant  vessels  has  changed  drastically  in  recent  years. 
The  old  tight  formation,  protected  by  a  bent-line  or  a  circular  screen 
while  steaming  majestically  over  the  horizon,  no  doubt  is  a  thing  of  the 
past.  Tacticai  units  may  be  smaller  and  there  may  be  a  larger  variety 
of  them  today.  Ships  may  spend  a  considerable  portion  of  their  time  in 
transit  either  in  very  small  groups  or  as  single  ships.  Yet  there  are 
situations  In  which,  even  in  transit,  a  number  of  ships  are  found  in 
reasonable  proximity  to  each  other.  An  example  is  the  current  practice 
of  rotating  groups  of  ships  between  WESTPAC  and  the  Pacific  Coast.  Under 
the  varied  circumstances  In  which  the  opportunity  for  providing  training 
support  while  at  sea  presents  Itself,  the  personnel  support  ship  would 
perform  Important  training  functions  for  the  other  forces.  Under  the 
same  circumstances,  it  also  would  perform  other  functions.  Important  ones 
of  these  are  concerned  with  corrective  and  preventive  maintenance  of 
electronic  equipment. 
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2.  tn-Port  Tender 

When  in  port*  the  personnel  support  ship  would  most  resemble  the 
ordinary  tender  in  its  functions.  It  would  be  a  floating  base  for  many 
of  the  needs  and  activities  associated  with  the  personnel  subsystem. 

It  would  continue  to  provide  training  services  of  a  number  of  different 
types.  It  also  would  provide  many  of  the  more  routine  record-keeping, 
assignment,  and  scheduling  services  necessary  for  the  personnel  organization. 
In  this  respect  it  would  take  over  a  large  proportion  of  the  "paperwork".' 
that  now  deluges  all  combatant  vessels.  A  key  factor  here  would  be  the 
high-speed,  digital,  data-processing  facilities  which  would  be  aboard  the 
support  ship. 

3.  Configuration  of  the  Ship 

The  facilities  and  functions,  which  will  be  describee  in  some  detail 
below,  might  be  housed  In  a  number  of  different  sizes  of  hulls.  This  is 
a  question  that  would  require  a  more  prolonged  consideration  of  the  factors, 
such  as  the  probable  sizes  of  the  forces  that  would  receive  seagoing  support. 
Obviously,  the  smaller  the  hull,  the  less  expensive  the  ship,  but  the  fewer 
the  functions  and  facilities  that  can  be  housed  aboard.  For  the  purposes 
of  describing  the  basic  concept  here,  it  will  be  assumed  that  a  relatively 
large  ship, for  example,  a  CVS.  would  be  modified  to  serve  as  the  personnel 
support  ship.  It  may  be  that  further  study  of  the  concept  would  suggest 
that,  rather  than  one  large  ship,  a  number  of  smaller  ships  would  be  more 
suitable.  However.  Judgment  on  this  question  is  reserved  at  this  time. 
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III.  improvements  in  personnel  readiness  offered  by  the  concept 


Oblective  Criterion  Information 

(Quantitative,  objective,  criterion  information  is  fundamental  to  more 
effective  training  and  utilization  of  personnel.  It  is  the  basic  informa* 
tion  upon  which  many  operations  designed  to  improve  personnel  readiness 
depend.  Yet  this  information  is  not  readily  nvai table  either  for  the 
performance  requirements  or  for  the  performance  capabilities  of  fleet 
personnel.  An  important  function  of  the  support  ship  would  be  to  provide 
for  the  collection  of  this  criterion  information.  This  would  be  done  by 
analysis  of  performance  requirements  and  application  of  suitable  proficiency 
tests.  The  assessment  of  the  performance  capabilities  of  fleet  personnel 
would  depend  upon  the  application  of  sophisticated  performance  and  achieve¬ 
ment  tests  constructed  and  administered  according  to  the  best  established 
psychometric  principles. 

The  administration  of  these  tests  might  be  handled  In  a  number  of 
different  ways.  Two  possibilities  that  seem  attractive  are  as  follows. 

One  would  be  to  tenporari 1y  transfer  those  individuals  to  be  tested  to 
the  support  ship,  without  advanced  notice.  There,  their  capabilities  would 
be  assessed  by  subjecting  them  to  job-sampie  and  other  kinds  of  tests. 
Representative  sampling  from  the  fleet  could  thus  provide  the  kind  of  detailed 
information  that  would  be  of  utmost  value  to  those  people  concerned  with 
improving  personnel  readiness. 

Another  way  to  approach  this  assessment  has  been  characterized  as 
"Jury  duty."  In  this  case,  the  individuals  to  be  tested  would  be  notified 
that,  at  some  specified  future  date,  they  were  to  be  tested  extensively 
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regarding  th'.lr  capability  to  perform  the  tasks  that  were  associated  with 
their  duties.  This  warning  period  would  allow  them  an  opportunity  to 
brush-up  on  the  areas  in  which  they  felt  weak.  This  would  be  a  desirable 
consequence  of  such  a  procedure. 

The  acquisition  of  criterion  information  would  be  extended  to  teams. 
Data  about  team  performance  would  be  collected  during  training  exercises 
as  well  as  In  special  testing  situations.  All  this  criterion  information 
would  be  recorded  and  made  available  In  a  form  that  would  be  useful  to 
training  ,  to  command,  and  to  others  concerned  with  improving  personnel 
readiness. 

2.  Feedback  to  Shorebased  Training 

One  of  the  chronic  problems  which  besets  shorebased  training  today 
is  the  disconnect  between  these  facilities  and  the  environment  in  which 
the  training  is  expected  to  pay  off.  Shorebased  schools  are  both 
geographically  and  philosophically  remote  from  this  environment.  Although 
some  informal  feedback  reaches  them  from  the  fleet,  in  the  form  of  periodic 
conferences,  and  of  individuals  rotated  to  training  commands  from  fleet 
duty,  these  sources  cannot  be  expected  to  provide  detailed,  objective 
criterion  information.  This  problem  would  be  solved  by  having  this 
information  collected  in  the  performance  environment  by  individuals  with 
this  responsibility.  Thiswould  provide  shorebased  training  facilities 
the  information  necessary  to  adjust  their  curricula  and  training  intervals 
to  the  job  requirements  in  the  fleet. 

3.  Effective  Shipboard  Training 

The  personnel  support  ship  would  provide  the  means  and  the  specialized 
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personnel  for  enlsuring  that  shipboard  training  is  conducted  systematicai iy, 
that  it  is  pianned  to  correct  observed  deficiencies  in  personnei  readiness, 
and  that  it  presents  worthwhile  learning  situations  to  the  participants. 

It  should  represent  an  extension  of  the  shorebased  training,  it  is 
recognized  this  is  not  now  capable  of  providing  the  necessary  maintenance 
of  high  skill  levels,  or,  in  some  cases,  of  developing  skills  to  a  high 
enough  level. 

The  personnel  support  ship  would  have  classroom  and  training  lab¬ 
oratory  facilities  aboard,  and  would  have  a  group  of  training  specialists 
whose  reponsibi I ities  were  solely  for  shipboard  training.  It  would 
provide  the  major  items,  then,  that  are  missing  in  the  fleet  today; 
personnel  and  facilities.  The  training  functions  that  the  support  ship 
would  perform  will  be  described  in  detail  later.  In  general,  they  will  be 
concerned  with  extending  the  training  begun  by  shorebased  establishments, 
tailoring  it  to  specific  needs,  and  fitting  it  into  the  operations  environ¬ 
ment.  These  training  functions  will  be  the  most  important  services 
provided  by  the  support  ship. 

4.  Integration  of  Shipboard  and  Shorebased  Training 

Enough  is  known  about  human  learning,  forgetting,  and  interference 
from  intervening  experience  to  lead  to  an  extension  of  current  concepts 
of  training.  High  skill  levels,  particularly  in  technical  areas, 
deteriorate  rapidly  without  reinforced  practice.  Although  shorebased 
schools  may  be  able  to  develop  skills  to  reasonably  high  levels,  loss  of 
these  skills  can  be  very  rapid  after  the  technician  graduates.  The 
haphazard  reinforcement  that  he  may  receive  while  performing  his  job  does 
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not  ensure  that  he  continues  to  develop  a  well-rounded  repertoire  of  skills* 
The  personnel  support  ship  offers  a  means  for  integrating  shipboard 
and  shorebased  training  in  terms  of  these  and  similar  considerations.  The 
effects  of  shorebased  training  need  not  be  lost  due  to  the  lack  of 
opportunity  to  maintain  skills  and  to  consolidate  learning. 

5«  Team  Training  Exercise  Simulation.  Control.  Analysis,  and  Deveiopment 
The  functions  performed  by  the  personnel  support  ship  for  individual 
training  would  be  extended  to  team  training.  However,  the  team  training 
problem  is  more  complicated.  Team  training  exercises  are  more  difficult 
to  plan,  to  conduct,  and  to  analyze.  It  is  much  more  difficult  to  ensure 
that  these  exercises  represent  profitable  learning  experiences  for  the 
participants.  The  requirements  for  team  performanco  are  less  clearly  known. 
Team  performance  is  more  difficult  to  score* 

Ail  of  these  differences  betwen  individual  and  team  training  make  it 
more  difficult  to  bring  the  latter  off  successfully.  Its  greater  require¬ 
ments  for  facilities  and  specialltsts  would  be  met  by  the  personnel  support 
ship.  The  ship  would  be  an  "exercise  ship"  at  sea,  controlling  the  exercise, 
simulating  information  system  inputs,  preserving  a  history  of  the  actions 
of  the  units  involved,  and  providing  post-exercise  debriefing* 

The  support  ship  would  be  the  center  for  planning  and  developing  new 
exercises*  It  would  be  the  instrumentality  for  improving  upon  the  current 
exercises  by  including  such  factors  as  tactical  surprise  and  counteraction 
by  the  simulated  enemy. 
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6.  Efficient  Util Izatlon  of  Ltml ted  Technical  Personnel . 

A  realistic  appraisal  of  the  manpower  picture  In  the  Navy  leads  to  the 
conclusion,  however  unpleasant  It  may  be,  that  there  always  Is  going  to 
be  a  shortage  of  highly  skilled  technical  personnel.  It  Is  Important  that 
these  personnel  be  utilized  as  efficiently  as  possible.  The  personnel 
support  ship  offers  a  new  approach  to  this  utilization  problem. 

Electronics  maintenance  Is  an  example  of  how  this  might  work.  Since 
there  are  not  enough  of  the  most  experienced  and  most  highly  skilled 
technicians  to  meet  each  ship's  needs,  a  nucleus  of  these  would  be  con¬ 
centrated  aboard  the  support  ship  to  provide  what  will  be  called  corrective 
maintenance  backup.  These  experts  would  serve  as  consultants  for  the 
technicians  aboard  other  ships,  communicating  with  them  via  the  communications 
facilities.  A  technician  faced  with  a  trouble  shooting  problem  in  an  equip¬ 
ment  which  he  could  not  solve,  would  be  required,  after  passage  of  a 
specified  time  Interval,  to  "call  up"  the  expert  on  the  support  shipand 
seek  his  assistance. 

This  would  be  "on-line"  backup,  in  distinction  to  the  type  of  main¬ 
tenance  support  now  furnished  by  tenders.  The  objective  would  be  to  reduce 
the  excessively  long  down-times  that  result  from  extremely  difficult  trouble 
shooting  problems.  This  type  of  corrective  maintenance  backup  is  common 
in  Industry.  It  has  been  used  for  many  years  with  digital  computing  centers. 
It  works.  This  utilization  of  the  best  technician  talent  would  be  in  sharp 
contrast  to  the  occasional  waste  of  this  talent  that  can  be  observed  in 
the  fleet  today.  Similar  utilization  of  talents  in  other  technical  areas 
should  be  possible. 
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7*  Integration  t>f  Fleet  Personnel  and  Operations  Subsystems 

The  coordination  problems  alluded  above,  with  respect  to  these  two 
subsystems,  could  be  alleviated  by  the  personnel  support  ship.  Personnel 
information  would  be  quickly  available  to  fleet,  force,  group,  unit,  and 
ship  commanders  to  assist  them  in  planning  and  executing  operations.  This 
availability  would  be  made  possible  by  the  presence  on  the  support  ship 
of  a  digital  data-processing  center  with  tape  or  disc  memory  for  storing 
personnel  information.  Using  this  information  as  a  base,  and  processing 
it  with  computer  programs,  command  would  be  able  to  schedule  the  utiliza¬ 
tion  of  their  personnel  more  effectively,  and  would  be  able  to  project 
personnel  strengths  for  future  operations  and  requirements,  (iuantltative 
and  qualitative  personnel  resources  would  be  at  command's  fingertips. 

This  information  could  be  utilized  to  develop  optimum  trade-offs  among  the 
many  conflicting  personnel  requirements  of  the  fleet. 

8.  Reduction  of  shipboard  Paperwork 

The  data-processing  center  on  the  support  ship  would  be  used  to 
replace  much  of  the  paper-shuffling  that  has  become  such  a  load  on  ship 
commanders  and  other  responsible  personnel.  This  function  of  the  support 
ship  would  be  analogous  to  some  of  the  functions  routinely  performed  in 
the  business  world  by  data-processing  centers.  It  should  be  feasible  to 
reduce  the  paperwork  load  to  a  minimum.  This  would  free  valuable  personnel 
for  more  Important  duties.  The  lags  and  inefficiencies  in  the  paperwork 
system  would  be  reduced.  The  morale  of  personnel  would  be  improved. 
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9.  Improvement  of  Shipboard  Morale 

The  support  ship  would  perform  a  number  of  functions  and  have  several 
facilities  which  should  directly  contribute  to  an  improvement  of  morale. 

Personnel  would  be  utilized  more  efficiently.  Training  would  be 
tailored  to  Individual  needs,  inexperienced  technicians  would  have  support 
from  experts.  The  many  minor  "disconnects"  in  the  system  would  be  reduced. 
And.  the  support  ship  would  include  personal  services  and  personal  counsel¬ 
ing.  All  these  factors  should  have  a  beneficial  effect  on  morale. 

The  more  obvious  factors  here  would  be  the  personal  services  that 
would  be  available  aboard  the  support  ship.  It  would  serve  as  a  center 
for  counseling  Individuals,  for  performing  the  functions  of  the  Chaplain's 
office,  and  for  providing  special  services.  The  last  could  be  extended 
considerably  by  utilizing  some  of  the  facilities  that  would  be  aboard  the 
ship. 

Although  entertainment  and  recreation  are  undoubtedly  important 
factors  in  morale,  it  is  assumed  that  the  more  basic  factors  relate  to 
the  individual's  ability  to  identify  with  the  group  and  the  organization. 
The  contribution  the  support  ship  would  make  to  improving  the  efficiency 
of  the  organization  and  to  more  enlightened  personnel  management  would  be 
expected  to  improve  these  basic  factors. 

10.  Increased  Read i ness  Per  Dollar  Cost 

The  support  ship  would  represent  a  major  investment,  it  would  need 
much  more  intensive  study,  requiring  much  more  time  than  now  is  available, 
to  identify  and  quentify  the  trade-off  between  this  cost  and  the  Improve¬ 
ment  In  personitel  readiness  that  would  result.  However,  it  is  believed 


E-14 


that  the  Improvements  In  personnel  readiness  that  are  offered  by  this 
concept  would  represent  a  gain  of  a  magnitude  that  would  be  worth  far 
more  than  the  investment  required. 

Some  of  these  improvements  can  be  re-emphas I zed  here.  The  pro¬ 
ficiency  levels  of  teams  and  individuals  would  be  upgraded.  Scarce 
technical  talent  would  be  spread  more  efficiently  to  the  areas  in  which 
it  Is  needed  and  not  wasted  In  other  areas.  Operating  personnel  would 
be  relieved  of  a  burdensome  load  of  paperwork  and  would  be  able  to  devote 
more  time  to  the  more  Important  aspects  of  their  Jobs.  Training  would 
produce  better  results  per  dollar  cost.  Costly  errors  In  maintaining  and 
operating  expensive  weapon  systems  would  be  reduced.  Improvements  In 
shipboard  morale  would  be  reflected  in  rising  re-enlistment  rates.  The 
data  base  would  be  established  for  continually  refining  and  developing 
training  methods  for  Individuals  and  teams.  The  improved  personnel  readi¬ 
ness  would  contribute  materially  to  the  readiness  of  the  forces  to  perform 
their  missions  and  tasks. 
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IV;  FUNCTIONS  OF  THE  PERSONNEL  SUPPORT  SHIP 


1,  Individual  Readiness 

a.  Assessment  of  capabilities.  Detailed,  objective  criterion 
information  describing  both  the  performance  requirements  for,  and  the 
performance  capabilities  of  fleet  personnel  would  be  collected  by  the 
psychometric  specialists  aboard  the  personnel  support  ship.  The  principal 
instruments  for  assessing  individual  capabilities  would  be  standarlzed 
performance  and  achievement  tests  constructed  and  administered  according 
to  the  best  principles. 

It  was  pointed  out  In  the  introduction  that  the  actual  administration 
of  criterion  measures  could  be  done  in  several  ways.  If  It  were  scheduled 
for  regular  Intervals  and  If  the  individuals  to  be  tested  were  notified 
in  advance,  it  undoubtedly  would  serve  as  a  stimulus  for  these  personnel 
to  review  the  requirements  for  their  Jobs.  This  would  be  a  beneficial 
side  effect,  but  of  course  it  might  not  reflect  the  true  capabilities  of 
the  personnel.  Another  procedure  would  be  to  select  subjects  at  random, 
without  prior  notification.  The  results  of  this  procedure  might  be  a  more 
accurate  reflection  of  the  actual  capabilities  of  the  personnel. 

Identification  and  description  of  performance  requirements  would 
require  the  development  of  suitable  methods.  The  final  objective  would  be 
a  quantitative  and  generail  task  taxonomy  through  which  specific  Job  require¬ 
ments  could  be  related  to  more  general  aptitudes  and  abilities. 

The  proficiency  testing  would  be  done  at  regular  intervals  and  the 
results  would  be  recorded  as  a  part  of  each  Individual's  record.  These 
records  then  would  be  used  to  describe  the  levels  of  proficiency  available 
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at  any  one  time  aboard  any  one  ship,  and  as  the  basis  for  scheduling 
shipboard  training  for  the  individual. 

The  psychometric  section  would  be  responsible  for  developing  and 
refining  better  methods  of  assessment.  To  this  end,  task  analyses  and 
proficiency  test  scores  would  not  be  filed  away  somewhere  and  forgotten. 

This  criterion  information  would  be  analyzed  for  indications  of  how 
better  criterion  measures  could  be  developed.  Ultimately,  the  psychometric 
section  aboard  the  support  ship  would  be  expected  to  bring  quantitative 
rigor  Into  this  important  field,  in  cooperation  with  the  shorebased 
faci 1 i ties. 

The  presence  of  a  data-processing  center  aboard  the  support  ship  would 
add  materially  to  the  resources  of  the  psychometric  section.  With  suitable 
programs,  analyses  of  test  scores  and  task  data  could  be  done  very  quickly. 
The  records  for  individuals  could  be  stored  on  magnetic  tape.  The  technology 
for  doing  this  exists.  Tape  files  of  this  sort  are  routinely  used  by 
insurance  and  banking  firms. 

b.  Remedial  training.  Our  standard  methods  of  training  individuals 
in  groups  called  classes  do  not  result  In  a.  uniform  level  of  skills  and 
knowledges  in  the  graduates.  The  variation  that  would  be  normally  expected 
in  a  class  sometimes  is  increased  in  Navy  schools  where  shortages  exist 
of  the  technicians  being  trained.  Under  those  circumstances,  individuals 
at  the  lower  end  of  the  class  may  be  carried  through  the  training  in  hopes 
that  they  will  prove  to  be  useful  anyway.  Not  all  of  the  men  aboard  a 
ship  may  have  the  opportunity  to  go  to  the  class  A  or  C  schools  which  would 
prepare  them  for  their  duties. 
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These  sources  of  variance  in  individual  proficiency  would  be 
attacked  by  the  training  specialists  aboard  the  support  ship.  Using  the 
criterion  measure  records,  they  would  schedule  remedial  training  for 
groups  of  individuals  who  exhibited  common  deticiences.  Early  identifi¬ 
cation  of  such  groups  would  be  done  by  means  of  sorting  the  records  on 
the  tape  files  In  the  computer  center. 

This  remedial  training  would  utilize  programmed  instruction  as  well  as 
the  more  conventional  techniques.  However,  whatever  techniques  might  be 
involved,  the  objective  of  remedial  training  would  be  to  reduce  individual 
deficiencies  by  tailoring  training  courses  to  correct  these  deficiencies. 

c.  Refresher  training.  It  was  pointed  out  in  the  introduction  that 
high  skill  levels,  particularly  In  technical  areas,  tend  to  deteriorate 
rapidly  without  practice  and  reinforcement.  Ordinarily,  the  job  environment 
does  not  provide  this  in  a  sufficiently  broad  or  systematic  fashion.  Some¬ 
times,  skilled  technicians  are  assigned  to  non-technical  duties  for  sub¬ 
stantial  periods  of  time,  during  which  a  large  proportion  of  their  skills 
might  be  lost,  Then^when  they  are  reassigned  to  a  technical  job,  they  may 
be  in  need  of  refresher  training  to  bring  them  back  up  to  the  desired 
levels. 

Learning,  forgettina.  and  Interference  from  intervening  experience 
are  closely  interwoven.  It  is  in  this  regard  that  the  support  ship's 
training  facilities  would  provide  the  continuity  that  is  desirable  after 
shorebased  training  ceases. 

As  in  the  case  of  remedial  training,  the  refresher  training  would  be 
tailored  to  suit  individual  needs.  Scheduling  and  planning  it  would  depend 
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upon  the  criterion  information  in  each  individual's  record,  and  upon 
Interaction  with  shorebased  training  staffs. 

d.  Hedernlzatlon  training.  This  would  fulfill  the  requirements 
imposed  by  modifications  of  equipment;  or  introduction  of  new  equipment, 
new  tactics,  and  new  techniques.  All  of  these  require  that  new  knowledges 
and  skills  be  learned  by  personnel. 

The  support  ship  would  play  an  important  role  In  those  Instances  in 
which  the  changes  might  not  have  the  desired  effects  unless  implemented 
through  the  Indoctrination  and  training  of  the  personnel.  There  have  been 
numerous  such  changes  in  the  past  which  might  have  been  more  effective  had 
they  been  supported  by  this  kind  of  field  implementation.  Modernization 
training  would  be  concerned  with  insuring  that  desired  changes  actually 
are  Implemented. 

In  some  cases,  this  training  would  provide  continuity  beyond  the 
service  testing  of  weapon  systems.  It  would  utilize  the  findings  of 
service  testing  to  develop  training  courses  and  curricula. 

In  short,  whenever  changes  in  hardware,  organization,  or  procedures 
would  require  a  period  of  adjustment  of  fleet  personnel  skills,  knowledges, 
and  attitudes,  the  modernization  training  function  of  the  personnel  support 
ship  would  be  important. 

e.  Experimental  training.  It  is  well  known  that  training  research 

has  uncovered  promising  techniques  which  have  not  been  picked  up  and  utilized 
in  the  day-to-day  training  establishments  of  the  Navy.  It  is  well  known, 
too,  that  promising  results  in  a  laboratory  setting  may  not  generalize  per¬ 
fectly  to  the  much  less  sheltered  setting  of  seagoing  operations.  Research 
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results  could  be  tested  In  the  harsher  environment  by  the  support  ship. 

The  ship  would  provide  the  facilities  and  personnel  for  extending 
promising  experimental  results  to  this  environment  and  validating  them. 

It  would  act  as  the  Intermediary  between  the  fleet  and  training  researchers 
when  the  latter  required  access  to  the  fleet.  The  training  personnel 
aboard  the  ship  would  serve  as  the  advisors  and  guides  to  personnel  of  the 
Type  and  Fleet  commanders  desirous  of  irvestigoting  experimental  training 
techniques  of  their  own.  These  services  would  include  assistance  in  plan¬ 
ning  designs,  in  drawing  samples,  in  scheduling  subjects,  and  in  carrying 
out  the  procedures  of  the  date  of  collection  and  analysis, 

f.  Scheduling  and  records.  It  has  been  Indicated  that  personnel  records 
would  be  kept  on  tape  files.  These  would  be  a  part  of  the  digital  computer 
center  aboard  the  support  ship.  Wllih  this  type  of  fast-access,  large- 
capacity  storage,  more  detailed  Information  about  each  man  can  be  recorded. 
This  detailed  information  would  be  the  basis  for  training,  manning,  assign¬ 
ment,  and  scheduling  decisions.  Using  these  records,  it  would  be  possible 
for  commanders  to  obtain  up-to-date  information  about  strengths  and  weak¬ 
nesses  in  their  personnel  structure.  They  could  project  trends  into  the 
future,  determine  immediate  personnel  readiness,  schedule  and  assign  talent 
more  effectively,  and,  generally  exert  more  satisfactory  control  over  the 
personnel  subsystem  in  the  fleet.  This  function  of  the  support  ship  might 
be  considered  to  be  a  seaward  extension  of  concepts  which  may  grow  out 
of  the  HOON  and  CAFRI  projects. 

2.  Team  Readiness 

a.  Scoting.  evaluating,  and  diagnosing  team  caoabi litles.  The  problem 
of  obtaining  adequate  criterion  measures  extend  to  team  performance.  The 
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problem  is  a  much  more  difficult  one  here,  but  the  need  is  no  less  great. 

In  this  sphere,  even  more  than  In  individual  training,  team  training  has 
been  forced  to  flounder  on,  doing  the  best  that  it  can  without  these  adequate 
criterion  measures.  It  would  appear  that  this  is  due  primarily  to  the 
expense  of  getting  such  measures.  This  expense  is  compounded  of  the  cost 
of  observing  team  performance,  recording  team  member  responses,  working  out 
the  relationships  between  individuals  and  team  performance,  and  assembling 
teams  In  an  environment  in  which  representative  performance  can  be  elicited. 

A  function  of  the  support  ship  would  be  to  collect  this  information 
from  the  teams  while  they  are  being  exercised  at  sea.  The  digital  computer 
center  aboard  the  support  ship  would  provide  the  facilities  for  recording 
their  performances  and  for  analyzing  them.  This  function  would  be  per¬ 
formed  primarily  for  the  NTDS  ships,  but  it  also  would  be  extended  to 
non-NTOS  ships. 

The  philosophy  here,  as  in  the  case  of  individual  performance  testing, 
would  be  to  develop  substantial  records  of  team  performance  which  could 
serve  as  normative  and  diagnostic  data.  Ten  years  of  experience  in  per¬ 
forming  a  similar  function  for  the  SAGE  system  in  the  Air  Force  has  resulted 
in  techniques  and  in  knowledge  that  could  serve  as  a  point  of  departure 
for  implementing  this  function  with  the  support  ship.  The  digital  equip¬ 
ment  and  the  computer  programming  group  associated  with  it  would  play  a 
key  role  In  this  implementation. 

b.  Planning  and  developing  team  training  exercises.  The  support 
ship  would  perform  the  function  of  planning  exercises  for  training  teams, 
from  ship  teams  to  task  forces,  basing  the  planning  on  the  performance 
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records  of  the  ptirticular  teams  Involved.  The  Intent  here  would  be  to 
extend  this  type  of  training  from  the  shorebased  facility  to  the  operational 
environment  and  to  make  It  more  effective  In  that  environment.  Personnel 
aboard  the  support  ship  would  have  responsibilities  for  this  planning  and 
scheduling,  from  the  identification  of  specific  needs  to  the  production 
of  Op  Orders  and  the  pre-exercise  briefing  of  the  teams. 

The  support  ship's  specialists  would  be  <*  sponsible  for  developing 
better  team  training  exercises.  They  would  utilize  the  histories  recorded 
from  the  exercises,  and  from  analysis  of  these  and  from  observation  of  the 
requirements  of  the  situation  would  develop  more  effective  exercises.  The 
fact  that  the  support  ship  would  be  present  as  an  exercise  control  ship 
while  fleet  exercises  are  being  conducted  would  help  In  this  development. 
Exercises  would  be  tailored  to  the  training  needs  of  the  particular  teams 
involved.  Also,  simulation  capabilities  made  possible  by  the  computer 
center  would  be  utilized  to  create  more  dynamic  training  situations.  In 
these  situations,  interaction  between  the  actual  and  the  simulated  forces 
could  be  more  extensive  and  more  realistic.  Thus,  the  elements  of  surprise, 
counteraction,  and  changes  in  force  structure  during  an  exercise  could  be 
incorporated  in  the  training. 

Control  ling  and  non  I  tori  no  exercises.  The  support  ship  would  act 
as  force  exercise  ship  in  a  fashion  somewhat  analogous  organizationally 
to  a  force  air  control  ship.  It  would  schedule,  initiate  and  control  the 
conduct  of  fleet  exercises,  and  monitor  the  performance  of  the  teams 
involved  while  the  exercises  were  in  progress. 
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An  importaat  aspect  of  this  function  of  the  support  ship  would 
be  Its  capability  to  exercise  the  smaller  teams,  such  as  the  CIC  team 
or  a  portion  of  It,  while  other  ships  were  underway  but  no  necessarily 
engaged  In  formal  fleet  exercises.  Time  in  transit  might  be  utilized 
in  this  way. 

Briefing  and  debriefing  teams.  Studies  of  group  learning  In 
task-oriented  teams  indicate  that  the  value  of  feedback  about  performance 
depends  very  heavily  upon  its  timeliness.  The  support  ship  would  have  the 
facitlitles  for  analyzing  performance  histories,  using  computer  programs, 
and  for  producing  debriefing  information  as  soon  as  the  exercise  is  over. 

In  fact,  in  those  cases  in  which  NTDS  ships  were  Involved,  some  feedback 
regarding  the  adequacy  of  performance  probably  could  be  supplied  during  an 
exercise. 

The  support  ship  would  be  capable  of  supplying  this  information  to 
other  ships  and  it  also  would  have  facilities  aboard  for  this  purpose. 

The  debriefing  rooms  would  have  the  necessary  displays,  in  some  cases on¬ 
line  with  the  computer,  to  present  detailed  and  accurate  debriefing  in¬ 
formation.  These  sessions  would  be  conducted  by  thetraining  specialist 
aboard  the  ship. 

The  necessary  briefing  for  preparing  teams  for  exercises  also 
would  be  conducted  in  this  fashion.  This  would  be  analogous  to  the 
"pre-sail"  briefings  that  often  are  given  at  a  FAAWTC  ashore. 

These  briefing  and  debriefing  sessions  would  be  conducted  as  learning 
sessions,  designed  to  be  optimum  learning  experiences  for  the  participants. 
For  this  reason,  most  of  them  would  be  conducted  aboard  the  support  ship, 
to  permit  the  all-important  face-to-face  interactions  between  the  training 
specialists  and  the  participants  in  the  exercises. 
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3*  Electronics  -Readiness 


a.  Corrective  maintenance  In  depth.  The  support  ship  would  make  It 
feasible  to  organize  electronics  maintenance  to  more  efficiently  utilize 
scarce  technician  talents.  Corrective  maintenance  in  depth  consists  of 
placing  highly  skilled  and  experienced  technicians  aboard  the  support 
ship  and  utilizing  them  essentially  as  inter-ship  technicians.  They  vould 
be  on  call  from  other  ships  in  the  force  and  would  be  available  when  the 
technicians  aboard  the  other  ships  ran  into  difficulties  in  trouble 
shooting  equipment.  The  concept  would  be  implemented  in  much  the  same 
fashion  as  similar  procedures  in  industry. 

Technicians  aboard  the  other  ships  would  be  given  a  certain  amount 
of  time  to  trouble  shoot  particular  equipment.  This  time  limit  would  be 
determined  by  the  system  availability  requirements  of  the  operations 
departments.  It  might  be  quite  liberal  for  some  equipments  for  which 
the  availability  is  not  critical.  The  time  limit  might  be  quite  stringent 
for  other  types  of  equipments  upon  which  the  operational  readinessof  the 
ship  almost  always  depends.  In  either  case,  the  technicians  aboard  the 
ship  would  be  allowed  to  attempt  to  trouble  shoot  the  equipment  up  to  the 
specified  time  limit.  Then,  they  would  be  required  to  call  up  the  support 
ship  specialist  nnd  ask  for  help.  The  specialist  on  the  support  ship  would 
have  all  of  the  necessary  technical  information  at  hand,  and  would  be  able 
to  provide  assistance  in  most  cases  via  standard  communications  links.  In 
some  cases,  they  might  have  to  use  the  s low-scan  television  broadcasting 
facilities  which  are  proposed  as  major  items  aboard  the  support  ship. 

These  items  will  be  descHbed  In  detail  later.  It  is  sufficient  here  to 
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point  out  that,  'with  such  facilities  and  with  the  relatively  simple 
iiKinitoring  equipment  aboard  other  ships,  the  electronics  specialists 
would  be  able  to  give  technicians  visual  aid. 

It  is  important  to  eirphasize  that  this  concept  of  corrective  main¬ 
tenance  in  depth  is  one  of  "on-line"  assistance.  It  would  be  given  to 
the  technicians  at  the  time  that  they  needed  it,  within  the  active  repair 
time,  and  would  be  designed  to  reduce  these  active  repair  times,  resulting 
in  acceptable  MTTR's.  It  has  been  found  in  the  comnercial  system  that 
a  further  beneficial  effect  accrues.  The  technicians  who  are  trouble 
shooting  know  that  they  are  going  to  have  to  call  for  help  within  a 
certain  period  of  time.  As  a  matter  of  pride,  they  work  harder  and  faster 
to  get  the  Job  done  themselves.  When  the  technician  did  call  for 
assistance,  he  would  be  receiving  expert  guidance  in  the  situation  and  at 
the  time  in  which  it  would  do  him  most  good  as  a  learning  experience.  The 
Immediacy  of  reinforcement  he  would  receive  would  make  his  learning  much 
more  effective.  He  could  be  given  step-by-step  guidance.  This  tutorial 
assistance  is  recognized  as  highly  valuable  for  training. 

b.  Preventive  maintenance  schedui ino.  The  chaotic  state  of  preventive 
maintenance  in  the  fleet  today  can  be  attributed,  to  a  large  extent,  to  the 
great  difficulties  attendant  to  fitting  preventive  maintenance  requirements 
to  the  limitations  in  the  number  of  personnel  available  for  performing  this 
maintenance.  Much  preventive  maintenance  that  in  theory  is  required  for 
equipment,  simply  is  not  done.  Routines  that  are  prescribed  for  a  particular 
equipment  are  unable  to  take  into  account  the  fact  that  this  equipment  is 
just  one  of  many  aboara  a  ship,  and  that  the  number  of  technicians  that  any 
one  ship  can  carry  is  limited. 
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Preventive  maintenance  schedules  presumably  are  based  upon  accurate 
data  about  failure  rates  and  wear  rates.  But  in  the  fleet  context,  It 
also  is  necessary  to  recognize  that  there  simply  may  not  be  enough  people 
to  get  all  of  the  specified  routines  done.  Therefore,  critical  items 
with  critical  requirements  for  preventive  maintenance  should  be  arranged 
in  some  priority  order. 

This  is  a  very  complex  scheduling  problem.  It  Is  not  feasible  without 
the  aid  of  a  high  speed  digital  computer.  There  are  Just  too  many  factors 
to  take  into  consideration.  There  are  just  too  many  equipments  with 
preventive  maintenance  requirements. 

Again,  the  precedent  has  been  established  in  industry.  Preventive 
maintenance  scheduling  has  been  "automated".  An  example  is  the  Ml/DAC 
system  developed  by  the  Mobil  Oil  Company.  This  system  automatically 
schedules  preventive  maintenance  for  equipment,  issues  assignments  to 
technicians,  records  updated  information  on  assignment  completions, 
reports  delinquent  assignments  to  management,  and  makes  realistic  per¬ 
formance  comparisons  for  cost  analysis. 

This  Is  the  type  of  control  over  preventive  maintenance  in  the  fleet 
that  probably  is  essential  if  it  is  to  be  performed.  The  concept  Is  in 
line. with  earlier  concepts  which  were  described  in  EPR6  reports  and  in  the 
Satterwhite  plan  several  years  ago.  The  computer  facilities  for  Implement¬ 
ing  those  concepts  were  not  available.  These  facilities  are  now  available 
and  this  type  of  computer  application  is  a  routine  matter. 

Preventive  maintenance  scheduling  ultimately  should  be  based  upon 
more  accurate  information  about  requirements.  This  information  would  be 
gathered  by  the  support  ship  in  the  form  of  maintenance  records,  and  would 
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be  utilized  to  establish  the  more  reaiistic  intervals  and  requirements 
which  might  be  much  less  demanding  on  personnel. 

Maintenance  records.  It  is  well  known  that  malfunction  reporting 
systems  are  extremely  difficult  to  implement.  They  generally  go  awry 
at  the  input  end.  Since  these  systems  represent  Just  so  much  more  paper¬ 
work  for  the  men  in  the  field.  It  is  difficult  to  get  them  to  fill  out 
the  forms.  This  experience  with  malfunction  reporting  systems  is  universal. 
The  services  have  had  the  problem  for  many  years.  Severe,  biases  are 
undoubtedly  introduced  into  the  system  by  the  selective  actions  of  the 
technicians. 

The  support  ship  would  be  an  ideal  medium  for  implementing  a  more 
effective  malfunction  reporting  system  and  for  collecting  the  associated 
maintenance  information  that  could  be  so  valuable  in  reliability  and 
maintainability.  The  ship  would  serve  as  a  center  for  collecting  and 
recording  this  information.  The  specialists  aboard  would  devise  and 
implement  statistical  sampling  plans.  Of  might  not  be  the  most  efficient 
way  to  proceed  to  attempt  to  collect  all  malfunctions,  and  all  malfunction 
data  for  ail  of  the  equipment  in  the  Navy.  There  is  a  precedent  in 
operations  research  for  using  a  sampling  plan.  )  The  support  ship  personnel 
would  be  responsible  for  the  bulk  of  collection  and  recording.  The 
technician  at  the  site  would  relay  the  information  to  the  support  ship  via 
communications,  where  it  could  be  punched  on  cards  or  put  on  tape.  This 
would  eliminate  the  burdensome  paperwork  now  required  of  the  technicians. 
Furthermore,  with  the  support  ship  in  the  same  environment,  the  technicians 
could  be  educated  and  supafvised  to  eliminate  the  biases  that  they  normally 
introduce. 
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An  important -aspect  of  this  function  would  be  the  capability^  in 
the  computer  center,  for  data  reduction  and  data  analysis.  Results  then 
could  be  printed  out  for  local  commanders  to  use,  or  sent  to  shorebased 
centers  where  further  reduction  and  analysis  might  be  performed. 

d,  inventory  control.  The  support  ship  would  have  facilities  for 
stocking  critical  equipment  items.  These  items  would  be  determined  from 
the  maintenance  records,  although  the  determination  might  not  depend 
altogether  upon  failure  rates.  For  example,  there  are  rarely  failing  items 
which  nevertheless  cripple  an  equipment  when  they  do  fail  and  for  which 
spares  seem  ordinarily  to  be  very  difficult  to  get.  The  support  ship 
might  in  these  instances  fulfill  a  supplementary  role  for  the  standard 
supply  faci I ities. 

The  chief  advantage  of  this  function  would  be  the  close-up  control 
of  inventory  offered  by  the  support  ship,  since  it  also  would  have  the 
responsibility  for  keeping  failure  records.  It  could  serve  as  an  important 
control  point  in  the  logistics  pipeline. 

e.  Transmitter  and  rece i ver  test  and  cal i brat  ion  signals.  As 
electronic  systems  become  more  sophisticated,  there  are  greater  require¬ 
ments  for  maintaining  accurate  frequency  standards,  accurate  timing 
standards,  and  accurate  measurement  of  transmitter  outputs  and  receiver 
sensitivities.  The  support  ship  would  have  facilities  aboard  for  performing 
these  functions.  These  would  be  designed  to  add  materially  to  the  capability 
for  determining  the  performance  levels  of  electronic  sensors  and  of  communi¬ 
cation  systems.  The  facilities  would  include  monitoring  equipment  for  the 
outpots  of  electronic  equipment  on  the  other  ships  and  for  assisting  in  its 
correct  operation  in  this  respect. 
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*•  Eniergencv  treatment.  It  would  be  possible  to  provide  certain 
scarce  and  sometimes  bulky  facilities,  such  as  Iron  lungs,  aboard  the 
support  ship.  Prompt  availability  of  these  Items  could  mean  the 
difference  between  life  or  death  of  the  patient.  These  facilities 
would  include  an  emergency  operating  clinic  as,  well,  and  other  items 
that  would  be  required  to  deal  with  medical  emergencies.  They  would 
be  staffed  with  the  medical  talents  conmensurate  with  the  requirements. 

b.  Envl ronmental  monitoring.  There  are  a  number  of  environmental 
hazards  which  the  support  ship  could  monitor  with  the  proper  facilities 
and  staff.  Radiation  hazards  are  known  to  exist  in  a  high  degree  aboard 
some  of  the  combatant  vessels,  such  as  carriers,  which  carry  a  large 
amount  of  varied  electronic  equipment.  Radiation  hazards  from  atomic 
sources  also  should  be  monitored  by  the  support  ship.  Other  hazards 
would  include  bacteriological  and  chemical  warfare,  ambient  noise  and 
temperature,  and  dangerous  fluids  and  gases.  The  support  ship  could  carry 
the  specialist  and  the  specialized  equipment  for  doing  this  environmental 
monitoring.  This  would  be  an  analogous  to  an  industrial  medicine  program. 
5,  Personal  and  Special  Services 

a.  Personal  Counseling.  An  important  factor  in  improving  the  morale 
of  personnel  would  be  the  availability  of  counseling  services  covering 
personal  problems  ranging  from  legal  to  emotional.  Some  of  these  services 
are  performed  by  the  Chaplain's  office,  and  the  Chaplain's  office  would  be 
included  in  these  facilities  on  the  support  ship.  Extensions  of  the 
counseling  services  now  available  would  be  possible.  For  example,  the 
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possibility  of  dealing  with  minor  civilian  legal  problems  which  may  arise 
"back  home"  while  an  individual  is  at  sea,  would  improve  morale. 

b.  Special  Services.  The  support  ship  would  be  the  control  point  for 
the  various  types  of  entertainment  that  are  made  available  to  other  ships. 
This  distribution  of  movies,  of  reading  material,  and  of  similar  items 
would  be  made  through  this  ship.  The  ship  might  also  carry  facilities 
for  a  gymnasium  and  for  other  sports.  The  television  broadcasting 
facilities  aboard  could  be  used  as  an  entertainment  medium. 

Pay-  accounting,  and  banking.  The  support  ship  would  perform 
these  personnel  functions.  It  is  likely  that  the  bulk  of  this  could  be 
automated  by  means  of  the  digital  computer  facility  aboard. 
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V  .  FACILITIES  AWARD  THE  PERSONNEL  SUPPORT  SHIP 


A  number  of  major  facllltes  would  be  required  to  assist  In  the 
performance  of  the  functions  described  above.  While  none  of  these  is 
considered  to  require  an  entireiy  new  hull,  they  wouid  require  that  an 
existing  hull  be  extensively  modified. 

^ •  Tactical  and  Functionai  Simulators 

The  support  ship  would  carry  problem  generators  and  the  other 
equipment  necessary  for  tactical  and  functional  simulation.  The  digital 
computer  center  would  be  used  in  an  on-iine  capacity  for  this  purpose. 

It  would  be  compatible  with  the  major  systems  coming  into  the  fleet, 
such  as  the  NTOS,  and  could  function  on-line  with  these  systems.  This 
equipment  would  include  the  necessary  special  devices  for  recording 
team  performance  histories,  for  simulating  enemy  targets,  for  providing 
feedback  to  trainees,  and  for  scheduling  and  controlling  exercises. 

The  support  ship  would  have  facilities  for  providing  training  in 
critical  tasks.  For  example,  there  is  a  need  for  decision-making 
trainers  which  could  be  programmed  for  training  decision-making  in  a 
variety  of  operator  jobs,  it  is  not  anticipated  that  the  support  ship 
would  carry  extensive  mock-ups  aboard.  If  required,  it  might  have  a 
general  purpose  mock-up,  containing  the  basic  items  of  equipment  that  are 
found  in  CIC's,  and  constructed  so  that  it  could  be  configured  to  major 
types  of  CIC's  aboard  combatant  vessels. 

2.  Slow-Scan  Television  Transmitters  and  Receivers 

Recent  technical  advances  make  it  possible  to  broadcast  television 
signals  in  a  much  narrower  bandwidth,  using  standard  radio  communications 


E-31 


nets.  These  s1ow*scan  systems  appear  to  be  quite  adequate  for  educational 
purposes.  The  support  ship  would  carry  broadcast  facilities.  Other  ships 
to  be  served  by  it  would  carry  receivers.  These  receivers  are  quite  simplet 
and  can  be  made  to  occupy  a  relatively  smali  space.  Using  this  one-way 
system,  the  support  ship  would  be  able  to  give  training  to  individuals 
and  small  teams  aboard  other  ships.  If  it  appeared  to  be  desirable, 
these  also  could  be  equipped  with  television  transmitters  for  a  two-way 
system.  The  potentialities  for  using  a  system  of  this  sort,  with  receivers 
modified  to  serve  as  teaching  machines,  are  obvious.  The  Instructor  on 
the  support  ship  could  serve  both  as  the  programmer  and  program,  and  could 
introduce  the  flexibility  that  at  least  some  programmed  instruction  experts 
consider  to  be  desirable. 

With  the  continued  development  of  computer-based  teaching  systems, 
the  television  receivers  might  be  switched  on-line  with  the  computer  and 
the  instruction  might  be  dispensed  via  this  machine.  The  precedents  for 
accomplishing  this  have  been  established  by  several  research  groups. 

3.  Electronics  Test.  Cal ibration.  and  Monitoring  Dev i ces 

The  Navy  recently  has  stated  an  objective  of  achieving  precise  frequency 
stability  and  synchronization,  in  order  to  lock  time  together  over  an  entire 
ocean.  This  would  provide  frequency  and  time  sources  of  a  high  order  of 
accuracy. 

A  chronic  problem  since  the  development  of  electronic  sensors  and 
communication  equipment  has  been  the  measurement  of  receiver  sensitivity 
and  of  transmitter  output.  It  is  extremely  difficult,  for  example,  to 
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V  .  FAC4LITIES  ABOARD  THE  PERSONNEL  SUPPORT  SHIP 


A  number  of  major  facilltes  would  be  required  to  assist  in  the 
performance  of  the  functions  described  above#  While  none  of  these  is 
considered  to  require  an  entirely  new  hull,  they  would  require  that  an 
existing  hull  be  extensively  modified. 

' •  Tactic?*  and  Functional  Simulators 

The  support  ship  would  carry  problem  generators  and  the  other 
equipment  necessary  for  tactical  and  functional  simulation.  The  digital 
computer  center  would  be  used  in  an  on-line  capacity  for  this  purpose. 

It  would  be  compatible  with  the  major  systems  coming  into  the  fleet, 
such  as  the  NTDS,  and  could  function  on-line  with  these  systems.  This 
equipment  would  include  the  necessary  special  devices  for  recording 
team  performance  histories,  for  simulating  enemy  targets,  for  providing 
feedback  to  trainees,  and  for  scheduling  and  controlling  exercises. 

The  support  ship  would  have  facilities  for  providing  training  In 
critical  tasks.  For  example,  there  is  a  need  for  decision-making 
trainers  which  could  be  programmed  for  training  decision-making  in  a 
variety  of  operator  Jobs*  It  is  not  anticipated  that  the  support  ship 
would  carry  extensive  mock-ups  aboard.  If  required,  it  might  have  a 
general  purpose  mock-up,  containing  the  basic  items  of  equipment  that  are 
found  in  CIC's,  and  constructed  so  that  it  could  be  configured  to  major 
types  of  CIC's  aboard  combatant  vessels. 

2.  S iow-Scan  Television  TransmI tters  and  Receivers 

Recent  technical  advances  make  it  possible  to  broadcast  television 
signals  in  a  much  narrower  bandwidth,  using  standard  radio  communications 
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nets.  These  slow-^scan  systems  appear  to  be  quite  adequate  for  educational 
purposes.  The  support  ship  wouid  carry  broadcast  facilities.  Other  ships 
to  be  served  by  it  would  carry  receivers.  These  receivers  are  quite  simpiet 
and  can  be  made  to  occupy  a  relatively  small  space.  Using  this  one-way 
system,  the  support  ship  would  be  able  to  give  training  to  individuals 
and  small  teams  aboard  other  ships.  If  it  appeared  to  be  desirable, 
these  also  could  be  equipped  with  television  transmitters  for  a  two-way 
system.  The  potentialities  for  using  a  system  of  this  sort,  with  receivers 
modified  to  serve  as  teaching  machines,  are  obvious.  The  instructor  on 
the  support  ship  could  serve  both  as  the  programmer  and  program,  and  could 
introduce  the  flexibility  that  at  least  some  programmed  instruction  experts 
consider  to  be  desirable. 

With  the  continued  development  of  computer-based  teaching  systems, 
the  television  receivers  might  be  switched  on-line  with  the  computer  and 
the  instruction  might  be  dispensed  via  this  machine.  The  precedents  for 
accomplishing  this  have  been  established  by  several  research  groups. 

3.  Eiectronics  Test.  Cal ibration.  and  Monitoring  Dev i ces 

The  Navy  recently  has  stated  an  objective  of  achieving  precise  frequency 
stability  and  synchronization,  in  order  to  lock  time  together  over  an  entire 
ocean.  This  would  provide  frequency  and  time  sources  of  a  high  order  of 
accuracy. 

A  chronic  problem  since  the  development  of  electronic  sensors  and 
communication  equipment  has  been  the  measurement  of  receiver  sensitivity 
and  of  transmitter  output.  It  is  extremely  difficult,  for  example,  to 
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measure  the  effective  range  of  a  search  radar* 

The  support  ship  would  carry  facilities  for  frequency  and  time  cali¬ 
bration.  It  would  carry  devices  for  measuring  output  of  other  ships 
transmitters  and  for  monitoring  and  calibrating  other  electronic  systems. 

It  might  be  possible  to  arrange  for  such  equipment  to  interrogate  the 
equipment  of  the  other  ships  In  the  force  on  some  schedule  and  to  maintain 
a  record  of  the  operational  status  of  this  equipment  in  this  way. 

The  great  advances  in  developing  integrated  electronic  circuitry 
reduce  the  space  required  for  most  electronic  equipment.  Therefore, 
simulation  facilities,  transmitter  test,  and  monitoring  facilities  need 
not  necessarily  occupy  a  large  volume  of  space,  aboard  the  support  ship. 
More  of  these  functions  now  can  be  performed  per  unit  volume  of  space. 

4,  On-Line  and  Off-Line  Digital  Computer  Center 

There  was  frequent  reference  to  a  digital  computer  center,  in  the 
above  descriptions  of  the  support  ship's  functions.  This  center  would 
consist  of  at  least  one  reasonably  large  capacity  digital  computer,  or  of 
several  smaller  machines, with  associated  peripheral  equipment  and  auxiliary 
tape  memory.  The  center  would  function  both  as  a  conventional  data- 
processing  center  and  as  an  on-line  processing  center,  in  the  latter 
capacity  It  would  be  used  for  simulation  for  exercises.  It  would  interact 
directly  with  NTOS  equipment.  As  was  suggested  above,  there  would  be  a 
number  of  other  on-line  uses  of  the  computer  center.  It  might  be  used  for 
computer-based  automated  instruction.  It  might  be  used  for  on-line 
electronic  equipment  performance-monitoring.  Under  some  circumstances, 
it  appears  feasible  to  use  a  computer  center  of  this  sort  on-line,  to  do 
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automated  troubl'e  shooting.  For  example,  If  the  symptom-malfunction 
matrix  for  a  circuit  Is  known,  It  could  be  stored  In  computer  memory 
and  utilized  by  technicians  trouble  shooting  that  circuit.  All  the 
technicians  would  have  to  do  would  be  to  Input  the  symptoms  to  the 
computer  and  a  relatively  simple  program  could  locate  the  malfunction. 

(It  should  be  pointed  out  that  this  possibility  would  be  difficult  to 
implement  in  proportion  to  the  size  of  the  symptom  malfunction  matrix. 

A  systems-levei  matrix  would  be  relatively  easy  to  get  for  most  systems; 
a  component  level  matrix  would  be  extremely  difficult,  if  not  impossible, 
to  get  for  a  large  system.) 

Off-line,  the  computer  center  would  be  utilized  for  a  variety  of 
more  or  less  routine  data-processing  functions,  from  the  mdintenance  of 
personnel  and  electronics  equipment  histories,  and  up-dating  of  these 
files,  to  doing  bookkeeping  and  accounting  chores.  Although  many  of 
these  kinds  of  things  are  routinely  done  In  the  business  world  today, 
the  implications  of  being  able  to  do  this  on  a  support  ship  are  far  from 
routine. 

This  is  one  of  the  points  at  which  there  would  be  promise  of  reducing 
the  heavy  burden  of  paperwork  that  is  now  placed  upon  the  operating  forces. 
As  much  of  this  paperwork  as  possible  should  be  eliminated  by  automating 
the  various  seml-clerlcal  functions  involved.  These  possibilities  might 
indicate  that  several  small  computers  would  be  more  desirable  than  one 
very  large  computer.  A  data-processing  center  organized  around  the  modular 
concept  certainly  would  fit  into  the  current  developments  in  the  computer 
field,  and  Into  the  practices  which  already  have  been  established  for  the 
NT 
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5«  Instructional-  Laboratories .  Cias5rc>cr.s.  ano'  Booths 

The  support  ship  would  have  spaces  for  conducting  classes  of  various 
sorts,  both  for  individual  and  for  tean  training.  The  spaces  should  be 
designed  on  a  rodular  concept  so  that  classrooms  of  varying  sizes  could 
be  made  simply  by  changing  partitions.  This  vould  permit  efficient  utiliza¬ 
tion  of  the  space. 

The  laboratories  would  be  designed  to  teach  those  technical  skills, 
such  as  electronics  trouble  shooting,  that  seem  to  be  in  such  short 
supply  In  the  fleet.  They  vfould  contain  equipment  for  doing  this,  but 
the  equipment  would,  in  most  cases,  not  consist  of  complete  operational 
systems.  The  more  difficult  parts  of  these  systems,  modified  to  serve 
as  trainers,  might  be  placed  in  the  laboratories. 

Classrooms  would  contain  all  of  the  audio-visual  equipment  necessary, 
such  as  slide  projectors,  movie  projectors,  and  back-projection 
screens. 

The  instructional  booths  would  be  designed  for  individual  training. 

They  might  be  In  a  separate  space  or  they  might  be  made  up  as  needed  from 
larger  classrooms.  Functional  trainers,  teaching  machines,  and  similar 
devices  would  be  used  in  these  booths. 

6.  Technical  Library,  and  Information  Retrieval  System 

The  support  ship  would  carry  aboard  a  technical  library  to  supplement 
the  technical  material  that  is  carried  aboard  combatant  vessels.  The  object 
would  be  to  provide  technical  information  in  depth,  so  that  it  would  be 
readily  available  to  Individual  needs.  The  physical  bulk  of  books  might 
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require  that  many  of  them  be  micro-filmed  and  stored  in  this  form. 

The  information  would  be  made  available  either  by  a  circulating  library 
arrangement,  or  by  a  question-answering  facility,  in  which  individuals 
could  call  up  and  ask  for  answers  to  specific  questions,  in  the  latter 
case,  it  might  be  desirable  to  have  an  information  retrieval  system 
operated  through  the  computer  center.  This  would  provide  for  very  rapid 
access  to  the  needed  information. 

7.  Biological  Laboratories  and  Med  I ca I  Cl inic 

These  facilities  would  support  the  medical  readiness  functions 
discussed  above.  The  biological  laboratories  should  contain  equipment 
for  monitoring  radiation,  bacteriological,  and  chemical  warfare  hazards. 

The  radiation  hazards  would  be  of  tv\n  sorts,  as  pointed  out  above.  Hazards 
generated  by  electronic  equipment  probably  are  the  more  serious  since 
personnel  must  live  with  them  from  day-to-day.  For  example,  very  powerful 
search  radars  can  generate  extremely  dangerous  radiation.  It  is  important 
that  there  be  facilities  for  monitoring  these  hazards  and  for  determining 
their  exact  extent.  The  laboratory  also  would  have  equipment  for  monitoring 
nuclear  radiation,  and  the  more  routine  industrial  hazards  from  noxious 
chemicals,  extreme  ambient  noise,  etc. 

The  medical  clinic  would  contain  facilities  alluded  to  in  the  descrip¬ 
tion  of  emergency  functions.  There  would  be  emergency  operating  facilities, 
and  devices  such  as  iron  lungs.  The  clinic  also  would  have  resources  for 

more  routine  problems.  There  could  be  an  optometry  shop  for  fitting  and 
perhaps  for  grinding  new  lenses  for  eyeglasses  and  a  dental  facility  for 
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repairing  dentures  and  bridges. 

8.  Cri ticai  i tem  Warehousing 

The  support  ship  v>ouid  have  certain  limited  storage  for  "critical 
items"  as  determined  by  inventory  control  procedures.  It  would  not 
in  this  regard  replace  the  conventional  supply  system.  However,  its 
closer  proximity  to  the  operating  ships  would  make  it  useful  as  a 
back-up  resource. 
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